00000001:02000400:1.0F:1787387772.429835:0:3305:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_hostid 00000001:02000400:1.0:1787387790.297858:0:3525:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787387793.054775:0:3588:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 417 MB/s 00000001:01000000:0.0:1787387793.304621:0:3588:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 515 MB/s 00000001:01000000:2.0F:1787387793.554498:0:3588:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3759 MB/s 00000020:02000000:1.0:1787387794.703298:0:3617:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_111_ga5eb910 00000400:02000000:3.0F:1787387796.164162:0:3632:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.115@tcp [8/256/0/180] 00008000:02000000:1.0:1787387801.053482:0:3782:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787387865.297941:0:5748:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787387877.851184:0:6498:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787387877.851191:0:6498:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787387877.851193:0:6498:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787387877.851325:0:6498:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000af72e5fd 00000080:02000400:0.0:1787387877.851335:0:6498:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787387877.861254:0:6498:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787387877.861269:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787387877.861308:0:6498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000cad94b6f) 00000020:00000080:0.0:1787387877.861327:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787387877.967009:0:6498:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787387877.967081:0:6498:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1787387877.993160:0:6498:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787387877.993476:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787387877.993490:0:6498:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787387877.993501:0:6498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a4473f5d 00000020:01000004:0.0:1787387877.993507:0:6498:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787387877.993511:0:6498:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787387877.993516:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000af72e5fd from MGS 00000020:01000004:0.0:1787387877.993520:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787387877.993529:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000663653dc) 00000020:00000080:0.0:1787387877.993539:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787387877.993595:0:6498:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000af72e5fd from MGS, refs=2 00080000:01000000:0.0:1787387877.993600:0:6498:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787387877.993606:0:6498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a4473f6b 00000100:00100000:0.0:1787387877.993727:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787387877.993849:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787387877.993854:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787387877.994625:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787387877.994632:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787387877.995318:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387877.995490:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787387877.995496:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787387877.996183:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787387877.996191:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787387877.996566:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787387877.996574:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787387877.997238:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387877.997242:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387877.997243:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387877.997603:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387877.997605:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387877.997607:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387877.998177:0:6498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787387878.003524:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787387878.247599:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3735 MB/s 00000001:01000000:2.0:1787387878.499802:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3579 MB/s 00000001:01000000:3.0:1787387878.750218:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1099 MB/s 00000001:01000000:0.0:1787387878.999497:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 763 MB/s 00080000:10000000:0.0:1787387879.005402:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:2.0:1787387879.020540:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787387879.021966:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787387879.024753:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787387879.027007:0:6498:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787387879.027051:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787387879.027234:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787387879.027254:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787387879.027616:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387879.027750:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787387879.027755:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787387879.042769:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787387879.042783:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787387879.043116:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787387879.043124:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787387879.043710:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787387879.043732:0:6498:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.115@tcp' 00000020:01000004:0.0:1787387879.043734:0:6498:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787387879.043782:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.115@tcp (typ=mgc) 00000020:00000080:0.0:1787387879.043793:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.115@tcp (000000002622201c) 00000020:00000080:0.0:1787387879.043808:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787387879.043885:0:6498:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c77d0ca2@MGC192.168.203.115@tcp: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1787387879.044056:0:6498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.115@tcp-0 is initialized 00000040:01000000:0.0:1787387879.044063:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787387879.049102:0:6517:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787387879.049451:0:6518:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787387879.049535:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.115@tcp (uuid 530741c0-7948-4b28-86b1-ece4c1322eb9) 00000020:00000080:2.0:1787387879.049561:0:6498:0:(genops.c:1406:class_connect()) connect: client 530741c0-7948-4b28-86b1-ece4c1322eb9, cookie 0x26817551a4473f79 00000100:00080000:2.0:1787387879.049572:0:6498:0:(import.c:510:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387879.049578:0:6498:0:(import.c:624:import_select_connection()) MGC192.168.203.115@tcp: import 00000000c77d0ca2 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787387879.049617:0:6498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dfcf72b7 x1874211945578624/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387879.049643:0:6498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS 00000020:01000004:2.0:1787387879.049659:0:6498:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787387879.049663:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787387879.049681:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000057900b7c) 00000020:00000080:2.0:1787387879.049694:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787387879.053422:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfcf72b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:530741c0-7948-4b28-86b1-ece4c1322eb9:3648:1874211945578624:0@lo:250: 00000100:00100000:3.0:1787387879.053513:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387879.053834:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945578624 00000100:00100000:1.0:1787387879.053843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945578624 00000100:00100000:1.0:1787387879.053894:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387879.053900:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044c07a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1874211945578624:12345-0@lo:250: 00010000:00080000:1.0:1787387879.053927:0:6514:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 530741c0-7948-4b28-86b1-ece4c1322eb9@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:1.0:1787387879.053953:0:6514:0:(genops.c:1406:class_connect()) connect: client 530741c0-7948-4b28-86b1-ece4c1322eb9, cookie 0x26817551a4473f87 00000100:00080000:1.0:1787387879.054071:0:6514:0:(import.c:65:import_set_state_nolock()) 00000000428e6e93 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787387879.054136:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044c07a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+5:3648:x1874211945578624:12345-0@lo:250: Request processed in 235us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387879.054143:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387879.057988:0:3648:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787387879.058004:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.115@tcp: connect to target with instance 0 00000100:00080000:3.0:1787387879.058013:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787387879.058019:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787387879.058023:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000c77d0ca2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787387879.058027:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787387879.058045:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787387879.058052:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfcf72b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:530741c0-7948-4b28-86b1-ece4c1322eb9:3648:1874211945578624:0@lo:250: 00000100:00100000:2.0:1787387879.085480:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387879.085674:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787387879.085680:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787387879.087040:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787387879.087050:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787387879.089654:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787387879.089664:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787387879.093252:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387879.093537:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787387879.093543:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787387879.095301:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787387879.095311:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787387879.145455:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387879.145640:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787387879.145646:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787387879.146678:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787387879.146687:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787387879.147640:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387879.147841:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787387879.147845:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787387879.148468:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787387879.148488:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787387879.149076:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387879.149212:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787387879.149217:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787387879.149678:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787387879.149685:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787387879.150234:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387879.150489:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787387879.150495:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787387879.151448:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787387879.151458:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787387879.165838:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387879.166037:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787387879.166048:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787387879.167121:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787387879.167128:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787387879.168177:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787387879.168186:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787387879.169248:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787387879.169275:0:6498:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787387879.169281:0:6498:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787387879.169527:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787387879.169565:0:6498:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.115@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787387879.169569:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787387879.169571:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787387879.169572:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387879.169573:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387879.169574:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387879.169575:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387879.169577:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387879.169578:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787387879.169579:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387879.169580:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387879.169582:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387879.169583:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787387879.169585:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787387879.169587:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787387879.169588:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787387879.169589:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387879.169590:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387879.169591:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387879.169592:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387879.169593:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387879.169594:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787387879.169595:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387879.169596:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387879.169597:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387879.169598:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787387879.169631:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787387879.169646:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945578752:0@lo:253: 00000100:00100000:1.0:1787387879.169714:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387879.169804:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000008485a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787387879.169893:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945578752 00000100:00100000:2.0:1787387879.169900:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945578752 00000100:00100000:2.0:1787387879.169970:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787387879.169979:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009405cc9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+5:6498:x1874211945578752:12345-0@lo:253: 20000000:01000000:2.0:1787387879.170023:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787387879.170026:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787387879.170264:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787387879.170312:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787387879.170615:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387879.171593:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787387879.172108:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787387879.172113:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787387879.172118:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787387879.172121:0:6516:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787387879.172134:0:6516:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787387879.172305:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387879.172686:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787387879.172705:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787387879.172723:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787387879.172740:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787387879.172755:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787387879.172803:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787387879.172811:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787387879.172824:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787387879.172829:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787387879.172841:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787387879.172846:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787387879.172857:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787387879.172870:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787387879.172894:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787387879.172899:0:6516:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787387879.172906:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387879.172987:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787387879.172997:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787387879.173010:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787387879.173023:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787387879.173036:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787387879.173044:0:6516:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787387879.173068:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787387879.173076:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787387879.173100:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787387879.173116:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787387879.173131:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787387879.173140:0:6516:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787387879.173163:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787387879.173171:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787387879.173184:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787387879.173199:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787387879.173244:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787387879.173273:0:6516:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787387879.173279:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787387879.173784:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787387879.174087:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787387879.174106:0:6516:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.115@tcp for mdt 20000000:01000000:2.0:1787387879.174108:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:2.0:1787387879.174121:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787387879.174126:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787387879.174136:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787387879.174141:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:2.0:1787387879.174150:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787387879.174157:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787387879.174168:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787387879.174181:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787387879.174206:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787387879.174209:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787387879.174213:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787387879.174262:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787387879.174265:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787387879.174764:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787387879.174907:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787387879.174936:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787387879.174953:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1787387879.174960:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787387879.174962:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787387879.175262:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787387879.175655:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787387879.175678:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787387879.175708:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1787387879.175722:0:6516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787387879.175725:0:6516:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787387879.175729:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787387879.175731:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787387879.175735:0:6516:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787387879.175741:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787387879.176013:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787387879.176136:0:6516:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787387879.189679:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787387879.189732:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787387879.189744:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787387879.189762:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787387879.189782:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.189799:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.189808:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.189815:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.189820:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.189826:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.189830:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe1a6c7d already unused, calling callback (000000003b559001) 00010000:00010000:3.0:1787387879.189833:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.189839:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.189849:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.189855:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.189869:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f8e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787387879.189891:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787387879.202655:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009405cc9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+5:6498:x1874211945578752:12345-0@lo:253: Request processed in 32671us (32934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387879.202675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387879.203262:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945578752:0@lo:253: 10000000:01000000:1.0:1787387879.203278:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787387879.203281:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787387879.203293:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787387879.203294:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387879.203295:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787387879.203296:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387879.203298:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387879.203299:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387879.203300:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787387879.203301:0:6498:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787387879.203303:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387879.203305:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787387879.203325:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000af72e5fd from lustre-MDT0000 10000000:01000000:1.0:1787387879.203374:0:6498:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787387879.203377:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787387879.203381:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff996b72b819c0 10000000:01000000:1.0:1787387879.203385:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387879.203393:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff996b72b819c0 from 1 10000000:01000000:1.0:1787387879.203395:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787387879.203428:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.203438:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.203446:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387879.203461:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945578880:0@lo:101: 00000100:00100000:1.0:1787387879.204629:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387879.204692:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e628e59 going to sleep for 11 seconds 00000100:00100000:3.0:1787387879.205217:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945578880 00000100:00100000:3.0:1787387879.205226:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945578880 00000100:00100000:3.0:1787387879.206021:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387879.206036:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002079e822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+5:6498:x1874211945578880:12345-0@lo:101: 00010000:00010000:3.0:1787387879.206053:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387879.206070:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4473f95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.206098:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4473f95 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.206109:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4473f95 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.206118:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe1a6c7d, rc 0) 00000100:00100000:3.0:1787387879.206198:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002079e822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+6:6498:x1874211945578880:12345-0@lo:101: Request processed in 168us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387879.206206:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387879.206294:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945578880:0@lo:101: 00010000:00010000:1.0:1787387879.206311:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.206332:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387879.206419:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579008:0@lo:501: 00000100:00100000:1.0:1787387879.206451:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387879.213067:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e628e59 going to sleep for 11 seconds 00000100:00100000:2.0:1787387879.213127:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945579008 00000100:00100000:2.0:1787387879.213137:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945579008 00000100:00100000:2.0:1787387879.214843:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387879.214853:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c379fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+6:6498:x1874211945579008:12345-0@lo:501: 00000100:00100000:2.0:1787387879.215651:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c379fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+6:6498:x1874211945579008:12345-0@lo:501: Request processed in 797us (9197us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387879.215662:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387879.215792:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579008:0@lo:501: 10000000:01000000:1.0:1787387879.215839:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787387879.215865:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.215875:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387879.215885:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996b46a34000 10000000:01000000:1.0:1787387879.215890:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787387879.215895:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff996b46a34000 10000000:01000000:1.0:1787387879.215897:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787387879.215900:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff996b46a34000 from 1 10000000:01000000:1.0:1787387879.215902:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787387879.215938:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 000000006de16fa9/0x26817551a4473fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.215946:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 000000006de16fa9/0x26817551a4473fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.215954:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 000000006de16fa9/0x26817551a4473fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387879.215982:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579136:0@lo:101: 00000100:00100000:1.0:1787387879.216015:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387879.216038:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e628e59 going to sleep for 11 seconds 00000100:00100000:2.0:1787387879.217033:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945579136 00000100:00100000:2.0:1787387879.217043:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945579136 00000100:00100000:2.0:1787387879.217081:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387879.217088:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000172dd9c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+6:6498:x1874211945579136:12345-0@lo:101: 00010000:00010000:2.0:1787387879.217099:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387879.217114:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004fd55ac/0x26817551a4473faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4473fa3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.217136:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004fd55ac/0x26817551a4473faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4473fa3 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.217266:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004fd55ac/0x26817551a4473faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4473fa3 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.217277:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004fd55ac, rc 0) 00000100:00100000:2.0:1787387879.217333:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000172dd9c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+7:6498:x1874211945579136:12345-0@lo:101: Request processed in 246us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387879.217340:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387879.217509:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579136:0@lo:101: 00010000:00010000:1.0:1787387879.217522:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 000000006de16fa9/0x26817551a4473fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.217530:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 000000006de16fa9/0x26817551a4473fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387879.217546:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787387879.217552:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000006de16fa9/0x26817551a4473fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.217558:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 000000006de16fa9/0x26817551a4473fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387879.217566:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787387879.217571:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387879.217576:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff996b46a34000 10000000:01000000:1.0:1787387879.217580:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787387879.217583:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787387879.217586:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787387879.217603:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.217610:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.217633:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387879.217648:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579264:0@lo:101: 00000100:00100000:1.0:1787387879.217679:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387879.217693:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e628e59 going to sleep for 11 seconds 00000100:00100000:2.0:1787387879.217823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945579264 00000100:00100000:2.0:1787387879.217828:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945579264 00000100:00100000:2.0:1787387879.217848:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387879.217854:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f554bd54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+7:6498:x1874211945579264:12345-0@lo:101: 00010000:00010000:2.0:1787387879.217862:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387879.217870:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e53033f1/0x26817551a4473fb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4473fb1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.217883:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e53033f1/0x26817551a4473fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4473fb1 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.217890:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e53033f1/0x26817551a4473fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4473fb1 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.217902:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e53033f1, rc 0) 00000100:00100000:2.0:1787387879.218256:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f554bd54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+8:6498:x1874211945579264:12345-0@lo:101: Request processed in 401us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387879.218262:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787387879.218817:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579264:0@lo:101: 00010000:00010000:1.0:1787387879.218831:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.218841:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387879.219028:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579392:0@lo:501: 00000100:00100000:1.0:1787387879.219062:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387879.219138:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e628e59 going to sleep for 11 seconds 00000100:00100000:3.0:1787387879.220191:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945579392 00000100:00100000:3.0:1787387879.220202:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945579392 00000100:00100000:1.0:1787387879.225022:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787387879.225042:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b89c3f32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+8:6498:x1874211945579392:12345-0@lo:501: 00000100:00100000:1.0:1787387879.225216:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b89c3f32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+9:6498:x1874211945579392:12345-0@lo:501: Request processed in 182us (6154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387879.225224:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787387879.225277:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579392:0@lo:501: 00000100:00100000:1.0:1787387879.225325:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579520:0@lo:503: 00000100:00100000:1.0:1787387879.225389:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387879.225406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945579520 00000100:00100000:2.0:1787387879.225413:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945579520 00000100:00100000:1.0:1787387879.225415:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e628e59 going to sleep for 11 seconds 00000100:00100000:1.0:1787387879.225438:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387879.225443:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084df3084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+9:6498:x1874211945579520:12345-0@lo:503: 00000100:00100000:1.0:1787387879.225523:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084df3084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+9:6498:x1874211945579520:12345-0@lo:503: Request processed in 79us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387879.225551:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000352aa214 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579520:0@lo:503: 00000100:00100000:2.0:1787387879.227006:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b4ff67d8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:6542:1874211945579648:0@lo:502: 00000100:00100000:2.0:1787387879.227067:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387879.227099:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set 000000009ec7e33c going to sleep for 11 seconds 00000100:00100000:3.0:1787387879.227237:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945579648 00000100:00100000:3.0:1787387879.227244:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945579648 00000100:00100000:3.0:1787387879.227280:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387879.227286:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d043302a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+10:6542:x1874211945579648:12345-0@lo:502: 00000100:00100000:3.0:1787387879.227398:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d043302a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+10:6542:x1874211945579648:12345-0@lo:502: Request processed in 111us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387879.227405:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387879.227557:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b4ff67d8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:6542:1874211945579648:0@lo:502: 00000020:01000000:2.0:1787387879.227581:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387879.227590:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387879.227592:0:6542:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787387879.227596:0:6542:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787387879.227599:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387879.227613:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000034cac69f) 00000020:00000080:2.0:1787387879.227627:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787387879.227631:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787387879.227716:0:6542:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787387879.227723:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a4473fc6 00000100:00100000:1.0:1787387879.227812:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:00000080:2.0:1787387879.228088:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787387879.228093:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387879.228096:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387879.228097:0:6542:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787387879.228100:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387879.228103:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387879.228104:0:6542:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787387879.228107:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387879.228119:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005b72cf75) 00000020:00000080:2.0:1787387879.228129:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787387879.228132:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787387879.228134:0:6542:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787387879.228136:0:6542:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787387879.228142:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787387879.228439:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000af72e5fd from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787387879.228453:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001a0091b2) 00000020:00000080:2.0:1787387879.228462:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787387879.228615:0:6542:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787387879.228621:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a4473fdb 00000020:00000080:2.0:1787387879.228720:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787387879.228727:0:6542:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787387879.228732:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x26817551a4473fe2 00080000:01000000:2.0:1787387879.228736:0:6542:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787387879.228739:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a4473fe9 00080000:10000000:2.0:1787387879.229287:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787387879.229465:0:6542:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787387879.238753:0:6542:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787387879.356628:0:6542:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787387879.358119:0:6542:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787387879.365737:0:6542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787387879.366523:0:6542:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787387879.372629:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000085ff4d3d) 00000020:00000080:2.0:1787387879.372657:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787387879.372734:0:6542:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787387879.372741:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a4473ff7 00000020:00000080:2.0:1787387879.376222:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787387879.379896:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1787387879.392436:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1787387879.400084:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1787387879.404797:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1787387879.407574:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1787387879.414678:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1787387879.421822:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x26817551a4473ffe 00000020:00000080:0.0:1787387879.423820:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787387879.423833:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387879.423840:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387879.423842:0:6542:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787387879.423845:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387879.423849:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387879.423850:0:6542:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787387879.423854:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787387879.423865:0:6542:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787387879.423868:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387879.423870:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387879.423872:0:6542:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787387879.423874:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387879.423878:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387879.423880:0:6542:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787387879.423894:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787387879.424243:0:6542:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787387879.424321:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000531cf1da pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:6542:1874211945579776:0@lo:502: 00000100:00100000:1.0:1787387879.434333:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387879.434401:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945579776 00000100:00100000:1.0:1787387879.434408:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set 000000003e678df7 going to sleep for 11 seconds 00000100:00100000:3.0:1787387879.434411:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945579776 00000100:00100000:3.0:1787387879.434464:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787387879.434481:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000405c54fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+9:6542:x1874211945579776:12345-0@lo:502: 00000100:00100000:3.0:1787387879.434617:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000405c54fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+9:6542:x1874211945579776:12345-0@lo:502: Request processed in 145us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387879.434625:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787387879.438491:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000531cf1da pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:6542:1874211945579776:0@lo:502: 00000020:01000000:1.0:1787387879.438540:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387879.438550:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387879.438552:0:6542:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787387879.438556:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787387879.441088:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787387879.441127:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787387879.441151:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.441163:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387879.441185:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b46a34000 from 1 10000000:01000000:3.0:1787387879.441187:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787387879.441239:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.441247:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.441255:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387879.441276:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d0d1f8cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579904:0@lo:101: 00000100:00100000:3.0:1787387879.441337:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387879.441391:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000069094592 going to sleep for 11 seconds 00000100:00100000:0.0:1787387879.441560:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945579904 00000100:00100000:0.0:1787387879.441568:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945579904 00000100:00100000:0.0:1787387879.441603:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787387879.441611:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009661846a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+9:6498:x1874211945579904:12345-0@lo:101: 00010000:00010000:0.0:1787387879.441622:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387879.441634:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b56e3a5b/0x26817551a447400c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474005 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.441654:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b56e3a5b/0x26817551a447400c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474005 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.441663:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b56e3a5b/0x26817551a447400c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474005 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.441670:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b56e3a5b, rc 0) 00000100:00100000:0.0:1787387879.441730:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009661846a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+10:6498:x1874211945579904:12345-0@lo:101: Request processed in 120us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387879.441737:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787387879.442024:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d0d1f8cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945579904:0@lo:101: 00010000:00010000:1.0:1787387879.442037:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.442045:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387879.445840:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000604c3776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580032:0@lo:256: 00000100:00100000:0.0:1787387879.446075:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387879.446110:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000094925b07 going to sleep for 11 seconds 00000100:00100000:3.0:1787387879.448573:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945580032 00000100:00100000:3.0:1787387879.448586:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945580032 00000100:00100000:3.0:1787387879.448644:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787387879.448652:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000751ef32c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+10:6498:x1874211945580032:12345-0@lo:256: 20000000:01000000:3.0:1787387879.448677:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787387879.448682:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787387879.448815:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000751ef32c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+10:6498:x1874211945580032:12345-0@lo:256: Request processed in 164us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387879.448824:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387879.449036:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000604c3776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580032:0@lo:256: 10000000:01000000:0.0:1787387879.451012:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787387879.451062:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.451075:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387879.451090:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b46a34000 from 1 10000000:01000000:0.0:1787387879.451093:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387879.451129:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.451136:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.451144:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387879.451169:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000604c3776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580160:0@lo:101: 00000100:00100000:0.0:1787387879.451219:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387879.451279:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000094925b07 going to sleep for 11 seconds 00000100:00100000:3.0:1787387879.451577:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945580160 00000100:00100000:3.0:1787387879.451585:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945580160 00000100:00100000:3.0:1787387879.451631:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787387879.451638:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001a02628 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+10:6498:x1874211945580160:12345-0@lo:101: 00010000:00010000:3.0:1787387879.451649:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387879.451669:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4be3558/0x26817551a447401a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474013 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.451690:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4be3558/0x26817551a447401a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474013 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.451700:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4be3558/0x26817551a447401a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474013 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.451708:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4be3558, rc 0) 00000100:00100000:3.0:1787387879.451753:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001a02628 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+11:6498:x1874211945580160:12345-0@lo:101: Request processed in 115us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387879.451760:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387879.451996:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000604c3776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580160:0@lo:101: 00010000:00010000:2.0:1787387879.452009:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.452028:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387879.452094:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b4ff67d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580288:0@lo:501: 00000100:00100000:2.0:1787387879.452120:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387879.452147:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000001a69434 going to sleep for 11 seconds 00000100:00100000:3.0:1787387879.452202:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945580288 00000100:00100000:3.0:1787387879.452207:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945580288 00000100:00100000:3.0:1787387879.452237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787387879.452242:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edc4ce7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+11:6498:x1874211945580288:12345-0@lo:501: 00000100:00100000:3.0:1787387879.452405:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edc4ce7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+11:6498:x1874211945580288:12345-0@lo:501: Request processed in 163us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387879.452412:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787387879.452489:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b4ff67d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580288:0@lo:501: 00000100:00100000:0.0:1787387879.452516:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099ccacdf pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580416:0@lo:503: 00000100:00100000:0.0:1787387879.452553:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387879.452580:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000036611cfe going to sleep for 11 seconds 00000100:00100000:2.0:1787387879.452581:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945580416 00000100:00100000:2.0:1787387879.452586:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945580416 00000100:00100000:2.0:1787387879.452608:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787387879.452613:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a1ec741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+11:6498:x1874211945580416:12345-0@lo:503: 00000040:00080000:2.0:1787387879.452644:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787387879.452686:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a1ec741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+11:6498:x1874211945580416:12345-0@lo:503: Request processed in 74us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387879.452693:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387879.452766:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099ccacdf pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580416:0@lo:503: 00000040:00080000:0.0:1787387879.454169:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787387879.454680:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787387879.454706:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387879.459841:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.459859:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387879.459925:0:6498:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787387879.459929:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996b46a34000 10000000:01000000:2.0:1787387879.459932:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996b46a34000 10000000:01000000:2.0:1787387879.459935:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787387879.459941:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b46a34000 from 1 10000000:01000000:2.0:1787387879.459956:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387879.459992:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.460000:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.460008:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387879.460029:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000029231147 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580544:0@lo:101: 00000100:00100000:2.0:1787387879.460088:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387879.460169:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000001a69434 going to sleep for 11 seconds 00000100:00100000:0.0:1787387879.460744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945580544 00000100:00100000:0.0:1787387879.460753:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945580544 00000100:00100000:0.0:1787387879.460843:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787387879.460851:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094f2e7eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+11:6498:x1874211945580544:12345-0@lo:101: 00010000:00010000:0.0:1787387879.460864:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387879.460876:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008df024b6/0x26817551a4474028 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474021 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.460897:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008df024b6/0x26817551a4474028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474021 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.460907:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008df024b6/0x26817551a4474028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474021 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.460916:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008df024b6, rc 0) 00000100:00100000:0.0:1787387879.460969:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094f2e7eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6498:x1874211945580544:12345-0@lo:101: Request processed in 119us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387879.460976:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387879.461043:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000029231147 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580544:0@lo:101: 00010000:00010000:3.0:1787387879.461056:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387879.461063:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387879.461118:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fe7585c pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580672:0@lo:501: 00000100:00100000:3.0:1787387879.461145:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387879.461241:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000058c49848 going to sleep for 11 seconds 00000100:00100000:2.0:1787387879.461287:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945580672 00000100:00100000:2.0:1787387879.461291:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945580672 00000100:00100000:2.0:1787387879.461317:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387879.461323:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f05a0a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6498:x1874211945580672:12345-0@lo:501: 00000100:00100000:2.0:1787387879.461949:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f05a0a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6498:x1874211945580672:12345-0@lo:501: Request processed in 624us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387879.461958:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787387879.462038:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fe7585c pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580672:0@lo:501: 00000100:00100000:3.0:1787387879.462068:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fe7585c pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580800:0@lo:503: 00000100:00100000:3.0:1787387879.462108:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387879.462126:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000058c49848 going to sleep for 11 seconds 00000100:00100000:2.0:1787387879.462175:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945580800 00000100:00100000:2.0:1787387879.462179:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945580800 00000100:00100000:2.0:1787387879.462198:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787387879.462202:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcf36885 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6498:x1874211945580800:12345-0@lo:503: 00000100:00100000:2.0:1787387879.462309:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcf36885 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6498:x1874211945580800:12345-0@lo:503: Request processed in 106us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387879.462316:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787387879.462971:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fe7585c pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945580800:0@lo:503: 00000100:00100000:0.0:1787387879.463687:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099ccacdf pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:6547:1874211945580928:0@lo:502: 00000100:00100000:0.0:1787387879.463740:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387879.463810:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set 0000000036611cfe going to sleep for 11 seconds 00000100:00100000:2.0:1787387879.463842:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945580928 00000100:00100000:2.0:1787387879.463847:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945580928 00000100:00100000:2.0:1787387879.463918:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787387879.463926:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007647b1e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6547:x1874211945580928:12345-0@lo:502: 00000100:00100000:2.0:1787387879.464043:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007647b1e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6547:x1874211945580928:12345-0@lo:502: Request processed in 118us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387879.464050:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787387879.464114:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099ccacdf pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:6547:1874211945580928:0@lo:502: 00000020:01000004:3.0:1787387879.464164:0:6547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787387879.464186:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005e5f0264) 00000020:00000080:3.0:1787387879.464203:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787387879.464391:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000af72e5fd from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787387879.464395:0:6547:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000af72e5fd from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787387879.464397:0:6547:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000af72e5fd 4 00010000:00080000:3.0:1787387879.464443:0:6547:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000da0ac5a2@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1787387879.466562:0:6547:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787387879.466655:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787387879.466694:0:6547:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787387879.466708:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x26817551a4474036 00000100:00080000:3.0:1787387879.466718:0:6547:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787387879.466723:0:6547:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000da0ac5a2 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787387879.466754:0:6547:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003fe7585c x1874211945581056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787387879.466797:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fe7585c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874211945581056:0@lo:38: 00000100:00100000:3.0:1787387879.466858:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787387879.466908:0:6547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787387879.468943:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945581056 00000100:00100000:1.0:1787387879.468955:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945581056 00000100:00100000:1.0:1787387879.468997:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387879.469003:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030367521 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1874211945581056:12345-0@lo:38: 00000100:00100000:1.0:1787387879.469085:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030367521 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1874211945581056:12345-0@lo:38: Request processed in 80us (2227us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787387879.469092:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387879.469134:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787387879.469141:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000da0ac5a2 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787387879.469151:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787387879.469154:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fe7585c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874211945581056:0@lo:38: 00000100:00100000:0.0:1787387879.472466:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f33e3977 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:6547:1874211945581184:0@lo:502: 00000100:00100000:0.0:1787387879.472542:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387879.472578:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set 000000002c751cf2 going to sleep for 11 seconds 00000100:00100000:2.0:1787387879.473383:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945581184 00000100:00100000:2.0:1787387879.473391:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945581184 00000100:00100000:2.0:1787387879.473527:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787387879.473536:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cc2b2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6547:x1874211945581184:12345-0@lo:502: 00000100:00100000:2.0:1787387879.473659:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cc2b2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6547:x1874211945581184:12345-0@lo:502: Request processed in 124us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387879.473668:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787387879.473757:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f33e3977 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:6547:1874211945581184:0@lo:502: 00000040:00080000:1.0:1787387879.473782:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787387879.476195:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787387879.476230:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387879.476255:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.476269:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787387879.476323:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787387879.476325:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787387879.476327:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387879.476328:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387879.476328:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387879.476330:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387879.476331:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787387879.476333:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787387879.476334:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387879.476335:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387879.476336:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387879.476343:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787387879.476367:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787387879.476370:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787387879.476371:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787387879.476372:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387879.476373:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387879.476374:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387879.476375:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387879.476376:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787387879.476376:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787387879.476377:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387879.476378:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387879.476379:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387879.476380:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787387879.476400:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787387879.476414:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000005e7bca0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945581312:0@lo:253: 00000100:00100000:2.0:1787387879.476489:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387879.476521:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e1437cbc going to sleep for 11 seconds 00000100:00100000:2.0:1787387879.476543:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945581312 00000100:00100000:2.0:1787387879.476549:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945581312 00000100:00100000:2.0:1787387879.476587:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787387879.476593:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abf41303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6498:x1874211945581312:12345-0@lo:253: 20000000:01000000:2.0:1787387879.476615:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787387879.476626:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787387879.492389:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787387879.492403:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787387879.492408:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787387879.492412:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787387879.492442:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.492460:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b56e3a5b/0x26817551a447400c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474005 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.492480:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.492516:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b56e3a5b/0x26817551a447400c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474005 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.492532:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b56e3a5b/0x26817551a447400c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474005 expref: 12 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387879.492545:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bfc2533c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945581440:0@lo:104: 00000100:00100000:0.0:1787387879.492602:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387879.492648:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075cfaf01 going to sleep for 11 seconds 00000100:00100000:0.0:1787387879.493021:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abf41303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6498:x1874211945581312:12345-0@lo:253: Request processed in 16427us (16531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387879.493031:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787387879.493405:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945581440 00000100:00100000:0.0:1787387879.493412:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945581440 00000100:00100000:0.0:1787387879.493446:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387879.493453:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009716376e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6536:x1874211945581440:12345-0@lo:104: 00010000:00010000:0.0:1787387879.493464:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.493522:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787387879.493527:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009716376e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6536:x1874211945581440:12345-0@lo:104: Request processed in 76us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387879.493540:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387879.493585:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bfc2533c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945581440:0@lo:104: 00010000:00010000:0.0:1787387879.493601:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387879.494406:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000005e7bca0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:6498:1874211945581312:0@lo:253: 10000000:01000000:3.0:1787387879.495567:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787387879.495573:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787387879.495575:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787387879.495576:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387879.495577:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387879.495579:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387879.495580:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387879.495581:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387879.495583:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787387879.495584:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787387879.495585:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787387879.495587:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387879.495588:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787387879.495603:0:6498:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787387879.496588:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387879.496597:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.496608:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000481386a4 already unused, calling callback (00000000c551f855) 10000000:00010000:1.0:1787387879.496610:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.496619:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387879.496624:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387879.496629:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387879.496678:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.496685:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387879.496703:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.496709:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 00000000481386a4/0x26817551a4474005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447400c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387879.496727:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387879.496738:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387879.496739:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387879.498252:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945581568:0@lo:103: 00000100:00100000:2.0:1787387879.498317:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387879.499728:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945581568 00000100:00100000:0.0:1787387879.499740:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945581568 00010000:00010000:0.0:1787387879.499773:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b56e3a5b/0x26817551a447400c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474005 expref: 12 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387879.499878:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387879.499995:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000759f4071 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+12:3650:x1874211945581568:12345-0@lo:103: 00010000:00010000:0.0:1787387879.500008:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387879.500014:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b56e3a5b/0x26817551a447400c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474005 expref: 12 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500025:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b56e3a5b/0x26817551a447400c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474005 expref: 12 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500041:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b56e3a5b/0x26817551a447400c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474005 expref: 12 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500055:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500063:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787387879.500077:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007665635s 00010000:00010000:0.0:1787387879.500090:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500097:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500103:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500109:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500114:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6030f73 already unused, calling callback (000000003b559001) 00010000:00010000:0.0:1787387879.500117:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500124:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500698:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387879.500712:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387879.501581:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000759f4071 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+11:3650:x1874211945581568:12345-0@lo:103: Request processed in 1589us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387879.501591:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387879.501743:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945581568:0@lo:103: 00010000:00010000:2.0:1787387879.505582:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.505600:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387879.505627:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c6030f73/0x26817551a447403d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787387879.513135:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1787387879.513303:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787387879.513706:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1787387879.513992:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787387879.514188:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1787387879.514367:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787387879.516340:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1787387879.516571:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787387879.517222:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1787387879.529095:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787387879.529457:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1787387879.529627:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1787387879.543324:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787387879.557915:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787387879.559971:0:6553:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1787387879.561791:0:6552:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787387879.561797:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787387879.562078:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787387879.562168:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787387879.562963:0:6498:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787387879.562971:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787387879.563080:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387879.564281:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787387879.567040:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787387879.567101:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787387879.567317:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787387879.567832:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1787387879.569025:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787387879.569163:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787387879.569343:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787387879.573219:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787387879.573400:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000040:00080000:1.0:1787387879.573585:0:6553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1787387879.574064:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000040:00080000:1.0:1787387879.578322:0:6553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:3.0:1787387879.579014:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787387879.579164:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787387879.579314:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000004:00080000:1.0:1787387879.579757:0:6553:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787387879.579762:0:6553:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1787387879.580029:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787387879.580199:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787387879.580333:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787387879.580769:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787387879.580898:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787387879.581051:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787387879.581186:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787387879.581835:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787387879.581993:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787387879.582136:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787387879.582271:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787387879.582748:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787387879.582944:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787387879.583075:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787387879.583225:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787387879.583896:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787387879.584055:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787387879.584201:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787387879.584372:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787387879.584519:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787387879.584688:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787387879.584816:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787387879.584946:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787387879.585141:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1787387879.587920:0:6498:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787387879.587956:0:6498:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa5d541cb3988 00100000:10000000:1.0:1787387879.587963:0:6498:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787387879.588742:0:6498:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787387879.588754:0:6498:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787387879.588770:0:6498:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787387879.588784:0:6498:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787387879.589511:0:6498:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787387879.589692:0:6498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787387880.044526:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387881.069045:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387882.096537:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387883.119064:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787387883.987183:0:6798:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787387884.155470:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787387884.276179:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787387884.276187:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b46a34000 from 3 10000000:01000000:0.0:1787387884.276192:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787387884.276235:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.276246:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.276264:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387884.276286:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bfc2533c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945581696:0@lo:101: 00000100:00100000:0.0:1787387884.276368:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387884.276408:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945581696 00000100:00100000:3.0:1787387884.276416:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945581696 00000100:00100000:0.0:1787387884.276420:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c57eb432 going to sleep for 11 seconds 00000100:00100000:3.0:1787387884.276491:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387884.276499:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097b413a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+11:6518:x1874211945581696:12345-0@lo:101: 00010000:00010000:3.0:1787387884.276512:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387884.276525:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002983bc67/0x26817551a447404b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474044 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387884.276545:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002983bc67/0x26817551a447404b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474044 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387884.276554:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002983bc67/0x26817551a447404b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474044 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387884.276561:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002983bc67, rc 0) 00000100:00100000:3.0:1787387884.276609:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097b413a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6518:x1874211945581696:12345-0@lo:101: Request processed in 111us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387884.276616:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787387884.276648:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bfc2533c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945581696:0@lo:101: 00010000:00010000:0.0:1787387884.276663:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.276671:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387884.276721:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bfc2533c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945581824:0@lo:256: 00000100:00100000:0.0:1787387884.276758:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387884.276786:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c57eb432 going to sleep for 11 seconds 00000100:00100000:3.0:1787387884.276832:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945581824 00000100:00100000:3.0:1787387884.276837:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945581824 00000100:00100000:3.0:1787387884.276869:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787387884.276876:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d201881 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6518:x1874211945581824:12345-0@lo:256: 20000000:01000000:3.0:1787387884.276889:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787387884.276904:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787387884.276906:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787387884.276977:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d201881 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+12:6518:x1874211945581824:12345-0@lo:256: Request processed in 102us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387884.276985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787387884.277118:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bfc2533c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945581824:0@lo:256: 10000000:01000000:0.0:1787387884.277157:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787387884.277163:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387884.277170:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787387884.780571:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787387884.780594:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787387884.780597:0:36:0:(import.c:65:import_set_state_nolock()) 00000000da0ac5a2 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787387884.780619:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000da0ac5a2 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787387884.780642:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ecf7fbf2 x1874211945582080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787387884.780750:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ecf7fbf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874211945582080:0@lo:38: 00000100:00100000:2.0:1787387884.780771:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387884.780780:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002f9c77ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945581952:0@lo:400: 00000100:00100000:2.0:1787387884.780813:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387884.780814:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387884.780876:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945581952 00000100:00100000:3.0:1787387884.780884:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945581952 00000100:00100000:3.0:1787387884.780934:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787387884.780942:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea5080da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+12:3652:x1874211945581952:12345-0@lo:400: 00000100:00100000:2.0:1787387884.781877:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945582080 00000100:00100000:2.0:1787387884.781885:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945582080 00000100:00100000:2.0:1787387884.781971:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787387884.781977:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc2533c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874211945582080:12345-0@lo:38: 00010000:00080000:2.0:1787387884.782002:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1787387884.782042:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x26817551a4474052 00000004:00100000:2.0:1787387884.782084:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787387884.782178:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000d4e62693 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387884.782312:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc2533c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874211945582080:12345-0@lo:38: Request processed in 333us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387884.782320:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387884.782523:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea5080da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+12:3652:x1874211945581952:12345-0@lo:400: Request processed in 1581us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387884.782532:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787387884.782629:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002f9c77ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945581952:0@lo:400: 00010000:00080000:0.0:1787387884.783338:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ecf7fbf2 x1874211945582080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787387884.783369:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787387884.783378:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787387884.783383:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787387884.783386:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000da0ac5a2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787387884.783392:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ecf7fbf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874211945582080:0@lo:38: 00000020:00000004:2.0:1787387884.965447:0:6850:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787387884.965642:0:6850:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787387885.164799:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387886.188705:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387887.212648:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787387887.651168:0:6951:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787387887.651739:0:6951:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787387888.242933:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387889.266809:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387889.900652:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e055cd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945582336:0@lo:400: 00000100:00100000:3.0:1787387889.900715:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387889.900779:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945582336 00000100:00100000:3.0:1787387889.900786:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945582336 00000100:00100000:3.0:1787387889.900824:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387889.900832:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091c9db3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945582336:12345-0@lo:400: 00000100:00100000:3.0:1787387889.900879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091c9db3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945582336:12345-0@lo:400: Request processed in 48us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387889.900886:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787387889.900918:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005e055cd3 x1874211945582336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387889.900929:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e055cd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945582336:0@lo:400: 00000100:00100000:0.0:1787387889.900983:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387889.900993:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e13c9c25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945582208:0@lo:400: 00000100:00100000:0.0:1787387889.901023:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387889.901430:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945582208 00000100:00100000:3.0:1787387889.901444:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945582208 00000100:00100000:3.0:1787387889.901475:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787387889.901480:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000280c3b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+12:3651:x1874211945582208:12345-0@lo:400: 00000100:00100000:3.0:1787387889.901519:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000280c3b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+12:3651:x1874211945582208:12345-0@lo:400: Request processed in 39us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387889.901525:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787387889.904719:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e13c9c25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945582208:0@lo:400: 00010000:00010000:2.0:1787387890.284984:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387891.311678:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387892.344308:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387893.356883:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387894.388109:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387895.020756:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fad3d4ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945582592:0@lo:400: 00000100:00100000:0.0:1787387895.020823:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387895.020913:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945582592 00000100:00100000:0.0:1787387895.020920:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945582592 00000100:00100000:0.0:1787387895.020968:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387895.020976:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005376bf1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945582592:12345-0@lo:400: 00000100:00100000:0.0:1787387895.021027:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005376bf1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945582592:12345-0@lo:400: Request processed in 52us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387895.021035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787387895.021070:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fad3d4ad x1874211945582592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387895.021085:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fad3d4ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945582592:0@lo:400: 00000100:00100000:3.0:1787387895.021153:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089f2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945582464:0@lo:400: 00000100:00100000:3.0:1787387895.021189:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387895.021846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945582464 00000100:00100000:0.0:1787387895.021852:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945582464 00000100:00100000:0.0:1787387895.022643:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787387895.022653:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6e18b70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+12:3650:x1874211945582464:12345-0@lo:400: 00000100:00100000:0.0:1787387895.022719:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6e18b70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+12:3650:x1874211945582464:12345-0@lo:400: Request processed in 68us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387895.022726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787387895.023780:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089f2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945582464:0@lo:400: 00010000:00010000:1.0:1787387895.404515:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387896.428712:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387897.452537:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787387897.457138:0:7450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787387897.457143:0:7450:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787387897.457144:0:7450:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787387897.457262:0:7450:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000000c2ca569 00000020:01000004:1.0:1787387897.457278:0:7450:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1787387897.457288:0:7450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787387897.457320:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000f0f2a4bb) 00000020:00000080:1.0:1787387897.457336:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787387897.551787:0:7450:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1787387897.551867:0:7450:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1787387897.593995:0:7450:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787387897.594211:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787387897.594223:0:7450:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787387897.594234:0:7450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a4474060 00000020:01000004:3.0:1787387897.594240:0:7450:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787387897.594273:0:7450:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787387897.594277:0:7450:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787387897.594283:0:7450:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787387897.594310:0:7450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787387897.594314:0:7450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787387897.639642:0:7450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787387897.639686:0:7450:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.115@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787387897.639691:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787387897.639692:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787387897.639694:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387897.639695:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387897.639696:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387897.639698:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387897.639699:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387897.639701:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787387897.639702:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787387897.639704:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387897.639705:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787387897.639709:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787387897.639716:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787387897.639718:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787387897.639719:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387897.639720:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787387897.639721:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387897.639722:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387897.639723:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387897.639724:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787387897.639725:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787387897.639726:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387897.639727:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787387897.639751:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787387897.639768:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e055cd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945582720:0@lo:253: 00000100:00100000:3.0:1787387897.639845:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387897.640309:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 0000000024b0e0be going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.642821:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945582720 00000100:00100000:0.0:1787387897.642836:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945582720 00000100:00100000:0.0:1787387897.642929:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387897.642938:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c7fcc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+12:7450:x1874211945582720:12345-0@lo:253: 20000000:01000000:0.0:1787387897.642973:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787387897.642977:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1787387897.642982:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1787387897.642985:0:6516:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1787387897.643024:0:6516:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1787387897.643280:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787387897.643434:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787387897.643447:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787387897.643464:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1787387897.643487:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1787387897.643511:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1787387897.646426:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1787387897.646451:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1787387897.646469:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1787387897.646474:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1787387897.646485:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1787387897.646490:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1787387897.646502:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1787387897.646968:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1787387897.647136:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1787387897.647147:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:0.0:1787387897.647159:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1787387897.647165:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787387897.647178:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1787387897.647183:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:0.0:1787387897.647196:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1787387897.647202:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787387897.647215:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1787387897.647228:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1787387897.647237:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787387897.647323:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1787387897.647332:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1787387897.647372:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1787387897.647392:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1787387897.647408:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1787387897.647413:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1787387897.647424:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1787387897.647442:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1787387897.647447:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1787387897.647475:0:6516:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787387897.647481:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1787387897.650995:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787387897.653719:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787387897.653749:0:6516:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.115@tcp for mdt 20000000:01000000:0.0:1787387897.653752:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:0.0:1787387897.653765:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787387897.653770:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787387897.653784:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787387897.653789:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:0.0:1787387897.653818:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787387897.653826:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1787387897.653840:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1787387897.653857:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1787387897.653902:0:6516:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1787387897.653911:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1787387897.656009:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1787387897.657135:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787387897.657164:0:6516:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.203.115@tcp for mdt 20000000:01000000:3.0:1787387897.657166:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:3.0:1787387897.657182:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787387897.657188:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787387897.657202:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787387897.657208:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:3.0:1787387897.657219:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787387897.657225:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1787387897.657236:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787387897.657263:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1787387897.657286:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787387897.657289:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787387897.657293:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787387897.657523:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787387897.657526:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787387897.658234:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787387897.658272:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787387897.658295:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787387897.658795:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787387897.658816:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787387897.658835:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787387897.658845:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787387897.658847:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787387897.661531:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787387897.661574:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787387897.661589:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787387897.661842:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1787387897.661865:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1787387897.661898:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1787387897.661910:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787387897.661913:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787387897.662636:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787387897.662658:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787387897.662685:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1787387897.662812:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1787387897.662829:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1787387897.662842:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1787387897.662854:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787387897.662857:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787387897.662862:0:6516:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787387897.662874:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787387897.663097:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1787387897.663741:0:6516:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787387897.680044:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787387897.680122:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.680142:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4473f95 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.680149:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e53033f1/0x26817551a4473fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4473fb1 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.680154:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008df024b6/0x26817551a4474028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474021 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.680161:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.680200:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008df024b6/0x26817551a4474028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474021 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.680214:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008df024b6/0x26817551a4474028 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474021 expref: 12 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387897.680228:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945582848:0@lo:104: 00000100:00100000:1.0:1787387897.680287:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387897.680378:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e53033f1/0x26817551a4473fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4473fb1 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.680386:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e53033f1/0x26817551a4473fb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4473fb1 expref: 12 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387897.680411:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8e38d03 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945582976:0@lo:104: 00000100:00100000:1.0:1787387897.680433:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387897.680455:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4473f95 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.680462:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4473f95 expref: 12 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387897.680470:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd5fb2d9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945583104:0@lo:104: 00000100:00100000:1.0:1787387897.680486:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387897.680495:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set 00000000216f7a73 going to sleep for 11 seconds 00000100:00100000:3.0:1787387897.680666:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945582848 00000100:00100000:3.0:1787387897.680674:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945582848 00000100:00100000:3.0:1787387897.680712:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945582976 00000100:00100000:3.0:1787387897.680714:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945582976 00000100:00100000:3.0:1787387897.680723:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945583104 00000100:00100000:3.0:1787387897.680724:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945583104 00000100:00100000:3.0:1787387897.680736:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387897.680742:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038d7f421 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+5:6516:x1874211945582848:12345-0@lo:104: 00010000:00010000:3.0:1787387897.680754:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.680820:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387897.680826:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038d7f421 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+5:6516:x1874211945582848:12345-0@lo:104: Request processed in 84us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387897.680832:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387897.680847:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387897.680852:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a456dc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6516:x1874211945582976:12345-0@lo:104: 00010000:00010000:3.0:1787387897.680858:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.680887:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787387897.680892:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a456dc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6516:x1874211945582976:12345-0@lo:104: Request processed in 40us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387897.680903:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387897.680915:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787387897.680920:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccec94e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6516:x1874211945583104:12345-0@lo:104: 00010000:00010000:3.0:1787387897.680926:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.680954:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787387897.680957:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccec94e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6516:x1874211945583104:12345-0@lo:104: Request processed in 38us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387897.680962:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787387897.680977:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787387897.680982:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.680988:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e19f67d9 already unused, calling callback (00000000c551f855) 10000000:00010000:3.0:1787387897.680991:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.680998:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387897.681003:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387897.681008:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387897.681034:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681040:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387897.681062:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681068:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 00000000e19f67d9/0x26817551a4474021 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474028 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681081:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787387897.681083:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681088:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e812f14 already unused, calling callback (00000000c551f855) 10000000:00010000:3.0:1787387897.681090:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681096:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387897.681100:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387897.681105:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387897.681115:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681121:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387897.681132:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681137:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 000000004e812f14/0x26817551a4473fb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4473fb8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681145:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387897.681154:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681159:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005620d6a7 already unused, calling callback (00000000c551f855) 10000000:00010000:3.0:1787387897.681162:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681167:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387897.681172:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387897.681177:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387897.681188:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681194:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387897.681198:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681203:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 000000005620d6a7/0x26817551a4473f95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4473f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.681214:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387897.681216:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387897.681217:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387897.681224:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387897.681239:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002a61f5e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945583232:0@lo:103: 00000100:00100000:3.0:1787387897.681267:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387897.681298:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c8d080fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945583360:0@lo:103: 00000100:00100000:3.0:1787387897.681326:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387897.681371:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387897.681378:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067e53238 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945583488:0@lo:103: 00000100:00100000:3.0:1787387897.681398:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387897.681423:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945583232 00000100:00100000:3.0:1787387897.681427:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945583232 00010000:00010000:3.0:1787387897.681441:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008df024b6/0x26817551a4474028 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474021 expref: 13 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387897.681455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945583360 00000100:00100000:3.0:1787387897.681457:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945583360 00010000:00010000:3.0:1787387897.681465:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e53033f1/0x26817551a4473fb8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4473fb1 expref: 14 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387897.681475:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945583488 00000100:00100000:3.0:1787387897.681477:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945583488 00010000:00010000:3.0:1787387897.681485:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4473f95 expref: 15 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387897.681496:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387897.681513:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000143b0b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3652:x1874211945583232:12345-0@lo:103: 00000100:00100000:1.0:1787387897.684400:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787387897.684420:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787387897.684447:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787387897.684464:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387897.684477:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ced2e6da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3649:x1874211945583360:12345-0@lo:103: 00010000:00010000:1.0:1787387897.684498:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387897.684525:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e53033f1/0x26817551a4473fb8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4473fb1 expref: 15 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.684540:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e53033f1/0x26817551a4473fb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4473fb1 expref: 15 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.684563:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387897.684638:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ced2e6da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3649:x1874211945583360:12345-0@lo:103: Request processed in 166us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387897.684645:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387897.684667:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787387897.684686:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387897.684692:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005868b827 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:3649:x1874211945583488:12345-0@lo:103: 00010000:00010000:1.0:1787387897.684699:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387897.684703:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4473f95 expref: 14 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.684710:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4473f95 expref: 14 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.684719:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387897.684738:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005868b827 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:3649:x1874211945583488:12345-0@lo:103: Request processed in 48us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387897.684743:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387897.684781:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067e53238 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945583488:0@lo:103: 00000100:00100000:1.0:1787387897.684789:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c8d080fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945583360:0@lo:103: 00000100:00100000:1.0:1787387897.684833:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945582848:0@lo:104: 00010000:00010000:1.0:1787387897.684842:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e53033f1/0x26817551a4473fb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4473fb1 expref: 13 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387897.684855:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8e38d03 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945582976:0@lo:104: 00010000:00010000:1.0:1787387897.684863:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fe1a6c7d/0x26817551a4473f9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4473f95 expref: 12 pid: 6515 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387897.684871:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd5fb2d9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945583104:0@lo:104: 00010000:00010000:1.0:1787387897.684886:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685536:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387897.685541:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008df024b6/0x26817551a4474028 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474021 expref: 11 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685552:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008df024b6/0x26817551a4474028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474021 expref: 11 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685561:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008df024b6/0x26817551a4474028 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474021 expref: 11 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685582:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685589:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685601:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685607:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685612:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685617:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685623:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e842ed83 already unused, calling callback (000000003b559001) 00010000:00010000:3.0:1787387897.685626:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685632:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685650:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.685659:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387897.685694:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000143b0b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+10:3652:x1874211945583232:12345-0@lo:103: Request processed in 4193us (4426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387897.685709:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387897.685741:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002a61f5e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945583232:0@lo:103: 00010000:00010000:1.0:1787387897.687657:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.687692:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.687698:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e842ed83/0x26817551a4474067 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787387897.687719:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787387897.691318:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c7fcc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+9:7450:x1874211945582720:12345-0@lo:253: Request processed in 48362us (51454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387897.691334:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787387897.691837:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e055cd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945582720:0@lo:253: 10000000:01000000:3.0:1787387897.691853:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787387897.691856:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787387897.691857:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787387897.691858:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787387897.691859:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1787387897.691860:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787387897.691861:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787387897.691863:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787387897.691864:0:7450:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787387897.691865:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787387897.691867:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787387897.691887:0:7450:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000c2ca569 from lustre-MDT0001 10000000:01000000:3.0:1787387897.691915:0:7450:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787387897.691917:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787387897.691924:0:7450:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff996b72b819c0 local copy 10000000:01000000:3.0:1787387897.691928:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787387897.691960:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.691970:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.691977:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387897.691994:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e055cd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945583616:0@lo:101: 00000100:00100000:3.0:1787387897.692029:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387897.692072:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 0000000024b0e0be going to sleep for 11 seconds 00000100:00100000:1.0:1787387897.692492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945583616 00000100:00100000:1.0:1787387897.692499:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945583616 00000100:00100000:1.0:1787387897.692549:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387897.692557:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a625aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+9:7450:x1874211945583616:12345-0@lo:101: 00010000:00010000:1.0:1787387897.692570:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387897.692584:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000921300de/0x26817551a4474075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447406e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.692607:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000921300de/0x26817551a4474075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447406e expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.692615:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000921300de/0x26817551a4474075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447406e expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.692624:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000921300de, rc 0) 00000100:00100000:1.0:1787387897.692706:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a625aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+10:7450:x1874211945583616:12345-0@lo:101: Request processed in 150us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387897.692713:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787387897.697000:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e055cd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945583616:0@lo:101: 00010000:00010000:2.0:1787387897.697027:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.697039:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387897.697190:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d4513de5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945583744:0@lo:501: 00000100:00100000:2.0:1787387897.697259:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387897.697298:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 000000007c97dc7e going to sleep for 11 seconds 00000100:00100000:1.0:1787387897.697445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945583744 00000100:00100000:1.0:1787387897.697452:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945583744 00000100:00100000:1.0:1787387897.697496:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787387897.697511:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c179ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+10:7450:x1874211945583744:12345-0@lo:501: 00000100:00100000:1.0:1787387897.697599:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c179ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+10:7450:x1874211945583744:12345-0@lo:501: Request processed in 97us (340us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387897.697607:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787387897.697647:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d4513de5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945583744:0@lo:501: 10000000:01000000:1.0:1787387897.697658:0:7450:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787387897.697675:0:7450:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787387897.697682:0:7450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.697689:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.697694:0:7450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.697712:0:7450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787387897.697741:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996b73aa7800 10000000:01000000:1.0:1787387897.697745:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787387897.697750:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff996b72b819c0 10000000:01000000:1.0:1787387897.697752:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787387897.697755:0:7450:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff996b72b819c0 from 1 10000000:01000000:1.0:1787387897.697757:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787387897.697780:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000efc221c6/0x26817551a447407c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.697798:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000efc221c6/0x26817551a447407c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.697805:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000efc221c6/0x26817551a447407c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387897.697818:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd5fb2d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945583872:0@lo:101: 00000100:00100000:1.0:1787387897.697844:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387897.697862:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 0000000008ec3c42 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.698026:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945583872 00000100:00100000:0.0:1787387897.698031:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945583872 00000100:00100000:0.0:1787387897.698063:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787387897.698069:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000882554a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+10:7450:x1874211945583872:12345-0@lo:101: 00010000:00010000:0.0:1787387897.698076:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387897.698088:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be1f7a45/0x26817551a4474083 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447407c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.698104:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be1f7a45/0x26817551a4474083 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447407c expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.698112:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be1f7a45/0x26817551a4474083 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447407c expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.698120:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be1f7a45, rc 0) 00000100:00100000:0.0:1787387897.698147:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000882554a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+11:7450:x1874211945583872:12345-0@lo:101: Request processed in 78us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.698152:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387897.698559:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd5fb2d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945583872:0@lo:101: 00010000:00010000:1.0:1787387897.698572:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000efc221c6/0x26817551a447407c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474083 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.698579:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000efc221c6/0x26817551a447407c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474083 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387897.698595:0:7450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787387897.698602:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000efc221c6/0x26817551a447407c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474083 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.698608:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000efc221c6/0x26817551a447407c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474083 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387897.698617:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff996b73aa7800 10000000:01000000:1.0:1787387897.698620:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787387897.698624:0:7450:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff996b73aa7800 from 1 10000000:01000000:1.0:1787387897.698626:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787387897.698638:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000929eb7e6/0x26817551a447408a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.698652:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000929eb7e6/0x26817551a447408a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.698659:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000929eb7e6/0x26817551a447408a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387897.698670:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd5fb2d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584000:0@lo:101: 00000100:00100000:1.0:1787387897.698696:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387897.698722:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 0000000008ec3c42 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.698764:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945584000 00000100:00100000:0.0:1787387897.698768:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945584000 00000100:00100000:0.0:1787387897.698806:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787387897.698813:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054de4a4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+11:7450:x1874211945584000:12345-0@lo:101: 00010000:00010000:0.0:1787387897.698821:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387897.698828:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d84f9e76/0x26817551a4474091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447408a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.698853:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d84f9e76/0x26817551a4474091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447408a expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.698859:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d84f9e76/0x26817551a4474091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447408a expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.698865:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d84f9e76, rc 0) 00000100:00100000:0.0:1787387897.698892:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054de4a4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+12:7450:x1874211945584000:12345-0@lo:101: Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.698898:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787387897.699104:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd5fb2d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584000:0@lo:101: 00010000:00010000:1.0:1787387897.699114:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000929eb7e6/0x26817551a447408a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.699121:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000929eb7e6/0x26817551a447408a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387897.699131:0:7450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787387897.699134:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000929eb7e6/0x26817551a447408a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.699139:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000929eb7e6/0x26817551a447408a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387897.699144:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787387897.699147:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387897.699152:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff996b73aa7800 10000000:01000000:1.0:1787387897.699155:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787387897.699158:0:7450:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787387897.699165:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787387897.699178:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000fa087001/0x26817551a4474098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.699185:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000fa087001/0x26817551a4474098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.699192:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000fa087001/0x26817551a4474098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387897.699202:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd5fb2d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584128:0@lo:101: 00000100:00100000:1.0:1787387897.699227:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387897.699246:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 0000000008ec3c42 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.699284:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945584128 00000100:00100000:0.0:1787387897.699288:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945584128 00000100:00100000:0.0:1787387897.699314:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387897.699320:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013bb1ae0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+12:7450:x1874211945584128:12345-0@lo:101: 00010000:00010000:0.0:1787387897.699326:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387897.699331:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e8d4255d/0x26817551a447409f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474098 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.699341:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8d4255d/0x26817551a447409f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474098 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.699376:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e8d4255d/0x26817551a447409f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474098 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.699382:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e8d4255d, rc 0) 00000100:00100000:0.0:1787387897.699407:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013bb1ae0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945584128:12345-0@lo:101: Request processed in 88us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.699413:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387897.699450:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd5fb2d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584128:0@lo:101: 00010000:00010000:0.0:1787387897.699459:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000fa087001/0x26817551a4474098 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.699465:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000fa087001/0x26817551a4474098 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387897.699558:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fad3d4ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584256:0@lo:501: 00000100:00100000:0.0:1787387897.699581:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387897.699598:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c7276232 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.699610:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945584256 00000100:00100000:0.0:1787387897.699613:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945584256 00000100:00100000:0.0:1787387897.699629:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787387897.699634:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bc4635f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945584256:12345-0@lo:501: 00000100:00100000:0.0:1787387897.699727:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bc4635f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945584256:12345-0@lo:501: Request processed in 92us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.699732:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787387897.699759:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fad3d4ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584256:0@lo:501: 00000100:00100000:0.0:1787387897.699781:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fad3d4ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584384:0@lo:503: 00000100:00100000:0.0:1787387897.699826:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387897.699838:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c7276232 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.699849:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945584384 00000100:00100000:0.0:1787387897.699852:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945584384 00000100:00100000:0.0:1787387897.699867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787387897.699872:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb6d00e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945584384:12345-0@lo:503: 00000100:00100000:0.0:1787387897.699937:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb6d00e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945584384:12345-0@lo:503: Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.699952:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787387897.699985:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fad3d4ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584384:0@lo:503: 00000040:00080000:0.0:1787387897.700203:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787387897.700261:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fad3d4ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584512:0@lo:502: 00000100:00100000:0.0:1787387897.700290:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387897.700303:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c7276232 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.700316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945584512 00000100:00100000:0.0:1787387897.700319:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945584512 00000100:00100000:0.0:1787387897.700335:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787387897.700339:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e5690fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945584512:12345-0@lo:502: 00000100:00100000:0.0:1787387897.700451:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e5690fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945584512:12345-0@lo:502: Request processed in 111us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.700458:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787387897.700490:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fad3d4ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584512:0@lo:502: 00000040:00080000:0.0:1787387897.700712:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787387897.700735:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1787387897.700748:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1787387897.700759:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1787387897.700772:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1787387897.700784:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1787387897.700808:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1787387897.700823:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1787387897.700836:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1787387897.700848:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1787387897.700859:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1787387897.700873:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1787387897.700885:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1787387897.700897:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1787387897.700925:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1787387897.700939:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1787387897.700950:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1787387897.700962:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1787387897.700974:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1787387897.700986:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1787387897.700998:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1787387897.701009:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1787387897.701032:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1787387897.701052:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fad3d4ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584640:0@lo:502: 00000100:00100000:0.0:1787387897.701085:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387897.701107:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c7276232 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.701122:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945584640 00000100:00100000:0.0:1787387897.701126:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945584640 00000100:00100000:0.0:1787387897.701142:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787387897.701146:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d265fca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945584640:12345-0@lo:502: 00000100:00100000:0.0:1787387897.701199:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d265fca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945584640:12345-0@lo:502: Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.701204:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787387897.701232:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fad3d4ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945584640:0@lo:502: 00000040:00080000:0.0:1787387897.701260:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1787387897.701267:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00010000:00010000:2.0:1787387897.704927:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387897.704941:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.704953:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009380cf87 already unused, calling callback (00000000c551f855) 10000000:00010000:2.0:1787387897.704969:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.704979:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387897.704985:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387897.704990:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387897.705025:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.705031:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387897.705062:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.705069:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a447406e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26817551a4474075 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.705083:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387897.705084:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387897.705086:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387897.705176:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002d38b781 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945584768:0@lo:103: 00000100:00100000:0.0:1787387897.705239:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387897.705386:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945584768 00000100:00100000:2.0:1787387897.705395:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945584768 00000100:00100000:2.0:1787387897.705441:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387897.705449:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fad3d4ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+13:3651:x1874211945584768:12345-0@lo:103: 00010000:00010000:2.0:1787387897.705460:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387897.705473:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000921300de/0x26817551a4474075 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a447406e expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.705495:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387897.705543:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fad3d4ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+12:3651:x1874211945584768:12345-0@lo:103: Request processed in 95us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387897.705550:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387897.705721:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002d38b781 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945584768:0@lo:103: 00000020:01000000:1.0:1787387897.706111:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387897.706122:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.706125:0:7463:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787387897.706130:0:7463:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787387897.706132:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387897.706144:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000009483b1f4) 00000020:00000080:1.0:1787387897.706163:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1787387897.706168:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787387897.706240:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787387897.706260:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a44740ad 00000020:00000080:1.0:1787387897.707104:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787387897.707111:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387897.707117:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.707119:0:7463:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787387897.707122:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387897.707126:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.707128:0:7463:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787387897.707131:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387897.707140:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000001758444a) 00000020:00000080:1.0:1787387897.707161:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1787387897.707167:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787387897.707169:0:7463:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787387897.707171:0:7463:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787387897.707177:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787387897.707232:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c2ca569 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787387897.707243:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000a6cf28e9) 00000020:00000080:1.0:1787387897.707264:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1787387897.707324:0:7463:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787387897.707330:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a44740c2 00000020:00000080:1.0:1787387897.707487:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787387897.707494:0:7463:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787387897.707499:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x26817551a44740c9 00080000:01000000:1.0:1787387897.707676:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787387897.707680:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a44740d0 00080000:10000000:1.0:1787387897.708193:0:7463:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787387897.708333:0:7463:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1787387897.856645:0:7463:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1787387897.856908:0:7463:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1787387897.865160:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787387897.865547:0:7463:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787387897.901693:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787387897.901706:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387897.901714:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.901716:0:7463:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787387897.901719:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387897.901724:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.901725:0:7463:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787387897.901728:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787387897.901732:0:7463:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:00000080:1.0:1787387897.901757:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387897.901783:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000012b10161) 00000020:00000080:1.0:1787387897.901813:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787387897.901820:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787387897.901895:0:7463:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787387897.901902:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787387897.901908:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a44740de 00010000:00080000:1.0:1787387897.901944:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000306cef45@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:1.0:1787387897.909264:0:7463:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1787387897.909783:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787387897.909796:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787387897.909830:0:7463:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787387897.909851:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a44740e5 00000100:00080000:1.0:1787387897.909861:0:7463:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387897.909867:0:7463:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000306cef45 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1787387897.909904:0:7463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d8e38d03 x1874211945584896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787387897.909922:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787387897.909983:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387897.909987:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.909989:0:7463:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787387897.909992:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787387897.909995:0:7463:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787387897.909996:0:7463:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787387897.909998:0:7463:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787387897.909999:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787387897.910002:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.910003:0:7463:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787387897.910005:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387897.910010:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.910012:0:7463:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787387897.910015:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787387897.910042:0:7463:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787387897.910055:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387897.910058:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.910060:0:7463:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787387897.910062:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387897.910065:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.910072:0:7463:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787387897.910076:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787387897.910077:0:7463:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787387897.910099:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387897.910102:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387897.910103:0:7463:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787387897.910106:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1787387897.910858:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8e38d03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945584896:0@lo:38: 00000100:00100000:0.0:1787387897.910926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787387897.910992:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1787387897.911021:0:7450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787387897.911035:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000fa087001/0x26817551a4474098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.911045:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000fa087001/0x26817551a4474098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387897.911052:0:7450:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b73aa7800 from 1 10000000:01000000:0.0:1787387897.911056:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787387897.911083:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.911091:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.911101:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387897.911117:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a3747036 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585152:0@lo:101: 00000100:00100000:0.0:1787387897.911147:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387897.911163:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da32af15 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.911180:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945585024:0@lo:400: 00000100:00100000:0.0:1787387897.911205:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387897.911249:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945584896 00000100:00100000:0.0:1787387897.911256:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945584896 00000100:00100000:0.0:1787387897.911286:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387897.911293:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b51c874a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1874211945584896:12345-0@lo:38: 00010000:00080000:0.0:1787387897.911314:0:6525:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:0.0:1787387897.911393:0:6525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a44740f3 00000004:00100000:0.0:1787387897.911407:0:6525:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787387897.911414:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787387897.911491:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945585152 00000100:00100000:0.0:1787387897.911495:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945585152 00000100:00100000:0.0:1787387897.911523:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787387897.911528:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096b7b77a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+12:7450:x1874211945585152:12345-0@lo:101: 00010000:00010000:0.0:1787387897.911539:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387897.911549:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c6030f73/0x26817551a44740fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44740ec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.911580:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c6030f73/0x26817551a44740fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44740ec expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.911590:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c6030f73/0x26817551a44740fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44740ec expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.911599:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c6030f73, rc 0) 00000100:00100000:0.0:1787387897.911632:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096b7b77a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945585152:12345-0@lo:101: Request processed in 104us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.911638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787387897.911665:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945585024 00000100:00100000:0.0:1787387897.911669:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945585024 00000100:00100000:0.0:1787387897.911693:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387897.911698:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea339926 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945585024:12345-0@lo:400: 00000100:00100000:0.0:1787387897.911729:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea339926 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945585024:12345-0@lo:400: Request processed in 31us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.911735:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787387897.911778:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007c4a9ab6 x1874211945585024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387897.911791:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945585024:0@lo:400: 00000100:00100000:0.0:1787387897.911815:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a3747036 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585152:0@lo:101: 00010000:00010000:0.0:1787387897.911826:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.911835:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387897.912421:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a3747036 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585280:0@lo:256: 00000100:00100000:0.0:1787387897.912460:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387897.912486:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da32af15 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.912534:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945585280 00000100:00100000:0.0:1787387897.912539:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945585280 00000100:00100000:0.0:1787387897.912560:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787387897.912566:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e8de078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945585280:12345-0@lo:256: 20000000:01000000:0.0:1787387897.912579:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787387897.913206:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787387897.913212:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787387897.913312:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e8de078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945585280:12345-0@lo:256: Request processed in 745us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.913320:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387897.923091:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a3747036 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585280:0@lo:256: 10000000:01000000:2.0:1787387897.924941:0:7450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787387897.924970:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.924982:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387897.924991:0:7450:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b73aa7800 from 1 10000000:01000000:2.0:1787387897.924994:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387897.925626:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.925636:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.925645:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387897.925665:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004cb258de pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585408:0@lo:101: 00000100:00100000:2.0:1787387897.925727:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387897.925772:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 0000000042d78e3f going to sleep for 11 seconds 00000100:00100000:2.0:1787387897.925876:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945585408 00000100:00100000:2.0:1787387897.925884:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945585408 00000100:00100000:2.0:1787387897.925945:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787387897.925953:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2fbbc73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+13:7450:x1874211945585408:12345-0@lo:101: 00010000:00010000:2.0:1787387897.925967:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387897.925977:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f1a82e7f/0x26817551a4474108 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474101 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.926591:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1a82e7f/0x26817551a4474108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474101 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.926604:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f1a82e7f/0x26817551a4474108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474101 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387897.926613:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f1a82e7f, rc 0) 00000100:00100000:2.0:1787387897.926662:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2fbbc73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:7450:x1874211945585408:12345-0@lo:101: Request processed in 710us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387897.926669:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787387897.931409:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004cb258de pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585408:0@lo:101: 00010000:00010000:3.0:1787387897.931442:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.931454:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387897.931585:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002a61f5e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585536:0@lo:501: 00000100:00100000:3.0:1787387897.931643:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387897.931686:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ff1f9d06 going to sleep for 11 seconds 00000100:00100000:3.0:1787387897.931705:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945585536 00000100:00100000:3.0:1787387897.931710:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945585536 00000100:00100000:3.0:1787387897.931756:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787387897.931765:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060ec2302 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:7450:x1874211945585536:12345-0@lo:501: 00000100:00100000:3.0:1787387897.931868:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060ec2302 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:7450:x1874211945585536:12345-0@lo:501: Request processed in 104us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387897.931876:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787387897.931911:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002a61f5e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585536:0@lo:501: 00000100:00100000:3.0:1787387897.931936:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002a61f5e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585664:0@lo:503: 00000100:00100000:3.0:1787387897.931981:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387897.931992:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ff1f9d06 going to sleep for 11 seconds 00000100:00100000:3.0:1787387897.932004:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945585664 00000100:00100000:3.0:1787387897.932007:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945585664 00000100:00100000:3.0:1787387897.932033:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787387897.932038:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093491c1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:7450:x1874211945585664:12345-0@lo:503: 00000040:00080000:3.0:1787387897.932074:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787387897.932110:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093491c1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:7450:x1874211945585664:12345-0@lo:503: Request processed in 72us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387897.932117:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787387897.932153:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002a61f5e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585664:0@lo:503: 00000040:00080000:3.0:1787387897.932410:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787387897.932458:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1787387897.932522:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787387897.938224:0:6525:0:(import.c:65:import_set_state_nolock()) 00000000d8e5cb3a : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387897.938319:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b51c874a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1874211945584896:12345-0@lo:38: Request processed in 27023us (27391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387897.938335:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387897.939339:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387897.939394:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787387897.939403:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787387897.939409:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787387897.939423:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000306cef45 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787387897.939438:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8e38d03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945584896:0@lo:38: 00000100:00100000:2.0:1787387897.940015:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387897.940028:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000043c74626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945585792:0@lo:41: 00000100:00100000:2.0:1787387897.940089:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387897.940292:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945585792 00000100:00100000:0.0:1787387897.940300:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945585792 00000100:00100000:0.0:1787387897.940343:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387897.940383:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db503c38 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874211945585792:12345-0@lo:41: 00000004:00000024:0.0:1787387897.940413:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787387897.940453:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db503c38 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874211945585792:12345-0@lo:41: Request processed in 73us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.940460:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387897.940493:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000043c74626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945585792:0@lo:41: 00000040:00080000:2.0:1787387897.982447:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1787387897.982858:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787387897.982887:0:7450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787387897.982906:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.982917:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387897.982963:0:7450:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787387897.982966:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996b73aa7800 10000000:01000000:3.0:1787387897.982969:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996b73aa7800 10000000:01000000:3.0:1787387897.982972:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787387897.982977:0:7450:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b73aa7800 from 1 10000000:01000000:3.0:1787387897.982979:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787387897.983011:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000a57f3947/0x26817551a447410f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.983019:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000a57f3947/0x26817551a447410f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387897.983043:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000a57f3947/0x26817551a447410f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387897.983063:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002a61f5e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585920:0@lo:101: 00000100:00100000:3.0:1787387897.983126:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387897.983171:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f47b9f94 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.983226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945585920 00000100:00100000:0.0:1787387897.983233:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945585920 00000100:00100000:0.0:1787387897.983280:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787387897.983286:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c44269c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:7450:x1874211945585920:12345-0@lo:101: 00010000:00010000:0.0:1787387897.983298:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387897.983309:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032702a10/0x26817551a4474116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447410f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.983330:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032702a10/0x26817551a4474116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447410f expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.983340:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032702a10/0x26817551a4474116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447410f expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387897.983389:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032702a10, rc 0) 00000100:00100000:0.0:1787387897.983424:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c44269c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945585920:12345-0@lo:101: Request processed in 138us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.983439:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787387897.983527:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002a61f5e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945585920:0@lo:101: 00010000:00010000:1.0:1787387897.983541:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000a57f3947/0x26817551a447410f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387897.983549:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000a57f3947/0x26817551a447410f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387897.983633:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df32f4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945586048:0@lo:501: 00000100:00100000:1.0:1787387897.983658:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387897.983685:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b6f7ec97 going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.984641:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945586048 00000100:00100000:0.0:1787387897.984652:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945586048 00000100:00100000:0.0:1787387897.984692:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787387897.984698:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071e6091b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945586048:12345-0@lo:501: 00000100:00100000:0.0:1787387897.984845:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071e6091b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945586048:12345-0@lo:501: Request processed in 146us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.984852:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787387897.985093:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df32f4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945586048:0@lo:501: 00000100:00100000:2.0:1787387897.985134:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000034b3febe pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945586176:0@lo:503: 00000100:00100000:2.0:1787387897.985182:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387897.985212:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 000000007c97dc7e going to sleep for 11 seconds 00000100:00100000:0.0:1787387897.985338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945586176 00000100:00100000:0.0:1787387897.985342:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945586176 00000100:00100000:0.0:1787387897.985404:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787387897.985411:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092fff678 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945586176:12345-0@lo:503: 00000100:00100000:0.0:1787387897.985491:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092fff678 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945586176:12345-0@lo:503: Request processed in 81us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387897.985508:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787387897.986425:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000034b3febe pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945586176:0@lo:503: 00000040:00080000:2.0:1787387897.986978:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787387897.987050:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000034b3febe pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945586304:0@lo:502: 00000100:00100000:2.0:1787387897.987101:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387897.987139:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 0000000046864271 going to sleep for 11 seconds 00000100:00100000:1.0:1787387897.988956:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945586304 00000100:00100000:1.0:1787387897.988968:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945586304 00000100:00100000:1.0:1787387897.989022:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787387897.989032:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000679cf2d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945586304:12345-0@lo:502: 00000100:00100000:1.0:1787387897.989195:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000679cf2d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945586304:12345-0@lo:502: Request processed in 164us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387897.989203:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787387897.989425:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000034b3febe pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945586304:0@lo:502: 00000040:00080000:0.0:1787387897.989646:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787387897.989675:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787387897.989689:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787387897.989703:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787387897.989716:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787387897.989729:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787387897.989742:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787387897.989754:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787387897.989768:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787387897.989781:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787387897.989795:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787387897.989809:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787387897.989831:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787387897.989844:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787387897.989858:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787387897.989871:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787387897.989885:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787387897.989898:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787387897.989910:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787387897.989922:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787387897.989935:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787387897.989947:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787387897.989960:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787387897.989973:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787387897.989986:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787387897.989999:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787387897.990011:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787387897.990023:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1787387897.990052:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000b7eca48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945586432:0@lo:502: 00000100:00100000:0.0:1787387897.990099:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387897.990125:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000acc21a4f going to sleep for 11 seconds 00000100:00100000:1.0:1787387897.993718:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945586432 00000100:00100000:1.0:1787387897.993732:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945586432 00000100:00100000:1.0:1787387897.993788:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787387897.993805:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098a23d75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945586432:12345-0@lo:502: 00000100:00100000:1.0:1787387897.993961:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098a23d75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945586432:12345-0@lo:502: Request processed in 166us (3862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387897.993975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787387897.994028:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000b7eca48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945586432:0@lo:502: 00000040:00080000:1.0:1787387897.994104:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787387897.994116:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787387897.999169:0:7469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787387897.999186:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000022a73a86) 00000020:00000080:2.0:1787387897.999227:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787387897.999438:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c2ca569 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787387897.999443:0:7469:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000c2ca569 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787387897.999445:0:7469:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000c2ca569 3 00010000:00080000:2.0:1787387897.999473:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000040c6c1b0@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1787387898.001018:0:7469:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1787387898.001108:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787387898.001146:0:7469:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787387898.001157:0:7469:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x26817551a4474124 00000100:00080000:2.0:1787387898.001167:0:7469:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387898.001172:0:7469:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000040c6c1b0 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787387898.001203:0:7469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000091a430e6 x1874211945586560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387898.001240:0:7469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787387898.001504:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000091a430e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874211945586560:0@lo:38: 00000100:00100000:3.0:1787387898.001566:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787387898.002045:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787387898.003959:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787387898.004011:0:7450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387898.004032:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000a57f3947/0x26817551a447410f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387898.004046:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000a57f3947/0x26817551a447410f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787387898.004096:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787387898.004098:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787387898.004099:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387898.004101:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387898.004102:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387898.004104:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387898.004105:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387898.004107:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387898.004108:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387898.004109:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387898.004110:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787387898.004114:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787387898.004116:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787387898.004118:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787387898.004119:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387898.004120:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387898.004121:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387898.004122:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387898.004123:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387898.004124:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387898.004125:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387898.004126:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387898.004130:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787387898.004154:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787387898.004170:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ddf0823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945586688:0@lo:253: 00000100:00100000:1.0:1787387898.004228:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387898.004262:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a2862a3f going to sleep for 11 seconds 40000000:00080000:1.0:1787387898.004315:0:7470:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:3.0:1787387898.006039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945586688 00000100:00100000:3.0:1787387898.006051:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945586688 00000100:00100000:3.0:1787387898.006104:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787387898.006113:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1f52513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945586688:12345-0@lo:253: 20000000:01000000:3.0:1787387898.006141:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787387898.006157:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787387898.014002:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945586560 00000100:00100000:2.0:1787387898.014016:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945586560 00000100:00100000:2.0:1787387898.014070:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387898.014077:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f79434 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874211945586560:12345-0@lo:38: 00010000:00080000:2.0:1787387898.014106:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:2.0:1787387898.014143:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x26817551a447412b 00000004:00100000:2.0:1787387898.014159:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787387898.014205:0:6521:0:(import.c:65:import_set_state_nolock()) 000000004c2f9e98 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387898.014288:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f79434 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874211945586560:12345-0@lo:38: Request processed in 211us (12723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387898.014296:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787387898.014379:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000091a430e6 x1874211945586560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387898.014391:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787387898.014397:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787387898.014404:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787387898.014408:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787387898.014410:0:3648:0:(import.c:65:import_set_state_nolock()) 0000000040c6c1b0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787387898.014415:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000091a430e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874211945586560:0@lo:38: 00000001:00100000:1.0:1787387898.032558:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787387898.032776:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787387898.032788:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787387898.033138:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1f52513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7450:x1874211945586688:12345-0@lo:253: Request processed in 27022us (28905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387898.033151:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 20000000:01000000:2.0:1787387898.033230:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787387898.033235:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787387898.033251:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387898.033266:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002983bc67/0x26817551a447404b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474044 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387898.033272:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c6030f73/0x26817551a44740fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44740ec expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387898.033278:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387898.033311:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c6030f73/0x26817551a44740fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44740ec expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387898.033371:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c6030f73/0x26817551a44740fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44740ec expref: 14 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387898.033387:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000091a430e6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945586816:0@lo:104: 00000100:00100000:2.0:1787387898.033421:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787387898.033457:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002983bc67/0x26817551a447404b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474044 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387898.033465:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002983bc67/0x26817551a447404b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474044 expref: 14 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387898.033473:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098a3fc51 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945586944:0@lo:104: 00000100:00100000:2.0:1787387898.033491:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387898.033503:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set 0000000042d78e3f going to sleep for 11 seconds 00000100:00100000:3.0:1787387898.033609:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945586816 00000100:00100000:3.0:1787387898.033616:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945586816 00000100:00100000:3.0:1787387898.033642:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945586944 00000100:00100000:3.0:1787387898.033644:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945586944 00000100:00100000:3.0:1787387898.033655:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387898.033661:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6e4c482 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6536:x1874211945586816:12345-0@lo:104: 00010000:00010000:3.0:1787387898.033671:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033725:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387898.033731:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6e4c482 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6536:x1874211945586816:12345-0@lo:104: Request processed in 70us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387898.033737:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387898.033748:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387898.033753:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000916ecd19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6536:x1874211945586944:12345-0@lo:104: 00010000:00010000:3.0:1787387898.033759:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033786:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787387898.033791:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000916ecd19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6536:x1874211945586944:12345-0@lo:104: Request processed in 39us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387898.033807:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787387898.033822:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787387898.033826:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033832:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008df024b6 already unused, calling callback (00000000c551f855) 10000000:00010000:3.0:1787387898.033835:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033843:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387898.033849:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387898.033854:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387898.033883:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033889:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387898.033903:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033910:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 000000008df024b6/0x26817551a44740ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44740fa expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033922:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387898.033924:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033930:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000da84595f already unused, calling callback (00000000c551f855) 10000000:00010000:3.0:1787387898.033932:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033938:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387898.033943:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387898.033948:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387898.033957:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033962:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387898.033973:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.033990:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447404b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034003:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387898.034004:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387898.034006:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387898.034011:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387898.034026:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed7a1b09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945587072:0@lo:103: 00000100:00100000:3.0:1787387898.034050:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387898.034083:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a85de09c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945587200:0@lo:103: 00000100:00100000:3.0:1787387898.034104:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387898.034126:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945587072 00000100:00100000:3.0:1787387898.034130:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945587072 00010000:00010000:3.0:1787387898.034144:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c6030f73/0x26817551a44740fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44740ec expref: 15 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387898.034161:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945587200 00000100:00100000:3.0:1787387898.034163:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945587200 00010000:00010000:3.0:1787387898.034171:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002983bc67/0x26817551a447404b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474044 expref: 16 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387898.034187:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387898.034193:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007968ce1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:3650:x1874211945587072:12345-0@lo:103: 00010000:00010000:3.0:1787387898.034202:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387898.034206:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c6030f73/0x26817551a44740fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44740ec expref: 16 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034214:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c6030f73/0x26817551a44740fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44740ec expref: 16 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034232:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387898.034256:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007968ce1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:3650:x1874211945587072:12345-0@lo:103: Request processed in 64us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387898.034262:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787387898.034273:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387898.034278:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037ff3a65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3651:x1874211945587200:12345-0@lo:103: 00010000:00010000:3.0:1787387898.034285:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387898.034288:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002983bc67/0x26817551a447404b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474044 expref: 15 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034295:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002983bc67/0x26817551a447404b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474044 expref: 15 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034305:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034311:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787387898.034323:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007665635s 00010000:00010000:3.0:1787387898.034326:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034332:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034337:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034372:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034384:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000065ad8fef already unused, calling callback (000000003b559001) 00010000:00010000:3.0:1787387898.034387:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034393:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034401:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387898.034409:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387898.034432:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037ff3a65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3651:x1874211945587200:12345-0@lo:103: Request processed in 154us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387898.034438:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387898.034492:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a85de09c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945587200:0@lo:103: 00000100:00100000:3.0:1787387898.034511:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed7a1b09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945587072:0@lo:103: 00000100:00100000:1.0:1787387898.034944:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ddf0823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:7450:1874211945586688:0@lo:253: 00010000:00010000:2.0:1787387898.035005:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c6030f73/0x26817551a44740fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44740ec expref: 14 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387898.035017:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000091a430e6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945586816:0@lo:104: 00010000:00010000:2.0:1787387898.035025:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002983bc67/0x26817551a447404b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474044 expref: 13 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387898.035033:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098a3fc51 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945586944:0@lo:104: 00010000:00010000:2.0:1787387898.035045:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387898.035052:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387898.035070:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387898.035075:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065ad8fef/0x26817551a4474132 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387898.039124:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787387898.039133:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787387898.039134:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787387898.039136:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387898.039137:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387898.039138:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387898.039139:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387898.039140:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787387898.039142:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387898.039143:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387898.039145:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387898.039146:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787387898.039173:0:7450:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787387898.052476:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1787387898.055690:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787387898.055962:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787387898.056134:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787387898.056323:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787387898.062242:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787387898.073548:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787387898.073795:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787387898.073981:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1787387898.074129:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787387898.074300:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1787387898.074522:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1787387898.087661:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1787387898.088985:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1787387898.089039:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed7a1b09 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874211945587328:0@lo:700: 00000100:00100000:3.0:1787387898.089104:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387898.089156:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 0000000024b0e0be going to sleep for 11 seconds 00000040:01000000:1.0:1787387898.089215:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1787387898.089328:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945587328 00000100:00100000:2.0:1787387898.089335:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945587328 00000100:00100000:2.0:1787387898.089421:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387898.089428:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a85de09c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1874211945587328:12345-0@lo:700: 00000100:00100000:2.0:1787387898.091255:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098a3fc51 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211945587456:0@lo:1000: 00000100:00100000:2.0:1787387898.091316:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387898.091393:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c96008be going to sleep for 11 seconds 00000040:01000000:1.0:1787387898.091821:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787387898.091928:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787387898.092404:0:7450:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787387898.092411:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787387898.092751:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787387898.093637:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945587456 00000100:00100000:3.0:1787387898.093648:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945587456 00000100:00100000:3.0:1787387898.093690:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787387898.093698:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091a430e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211945587456:12345-0@lo:1000: 00000100:00100000:3.0:1787387898.093790:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091a430e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211945587456:12345-0@lo:1000: Request processed in 93us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387898.093808:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387898.093936:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098a3fc51 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211945587456:0@lo:1000: 00000040:01000000:2.0:1787387898.093969:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1787387898.094001:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098a3fc51 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211945587584:0@lo:700: 00000100:00100000:2.0:1787387898.094041:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387898.094064:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a986687d going to sleep for 11 seconds 00000020:00080000:0.0:1787387898.096492:0:7474:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787387898.096501:0:7474:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:1.0:1787387898.096834:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1787387898.096945:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945587584 00000100:00100000:1.0:1787387898.096954:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945587584 00000100:00100000:1.0:1787387898.100680:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387898.100699:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d58b3d7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211945587584:12345-0@lo:700: 00000100:00100000:1.0:1787387898.100791:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d58b3d7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211945587584:12345-0@lo:700: Request processed in 99us (6750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387898.100798:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387898.102582:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098a3fc51 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211945587584:0@lo:700: 00000100:00100000:3.0:1787387898.102671:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ced2e6da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1874211945587712:0@lo:900: 00000100:00100000:3.0:1787387898.102734:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387898.102775:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000095f5a7d7 going to sleep for 11 seconds 00000100:00100000:2.0:1787387898.103073:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945587712 00000100:00100000:2.0:1787387898.103080:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945587712 00000100:00100000:2.0:1787387898.103139:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387898.103145:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005868b827 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1874211945587712:12345-0@lo:900: 00000100:00100000:2.0:1787387898.103197:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005868b827 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1874211945587712:12345-0@lo:900: Request processed in 52us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387898.103203:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787387898.103537:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ced2e6da x1874211945587712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787387914 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387898.103549:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ced2e6da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1874211945587712:0@lo:900: 00000100:00100000:3.0:1787387898.103644:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ced2e6da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211945587840:0@lo:1000: 00000100:00100000:3.0:1787387898.103686:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387898.103707:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 000000004b058d28 going to sleep for 11 seconds 00000100:00100000:2.0:1787387898.104143:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945587840 00000100:00100000:2.0:1787387898.104150:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945587840 00000100:00100000:2.0:1787387898.104183:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387898.104189:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000143b0b00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211945587840:12345-0@lo:1000: 00000100:00100000:2.0:1787387898.104270:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000143b0b00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211945587840:12345-0@lo:1000: Request processed in 81us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387898.104277:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387898.104320:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ced2e6da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211945587840:0@lo:1000: 00000004:00080000:2.0:1787387898.104412:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000095f5a7d7 with version 0 00000020:00100000:2.0:1787387898.104427:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787387898.104432:0:7476:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d2662c26 x1874211945588096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787387898.104445:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2662c26 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211945588096:0@lo:1000: 00000100:00100000:2.0:1787387898.104471:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387898.104488:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945588096 00000100:00100000:2.0:1787387898.104491:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945588096 00000100:00100000:2.0:1787387898.104507:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787387898.104513:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000337daf59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211945588096:12345-0@lo:1000: 00000100:00100000:2.0:1787387898.104851:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c96008be going to sleep for 11 seconds 40000000:02000000:2.0:1787387898.110091:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:1.0:1787387898.117479:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787387898.117554:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787387898.118481:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787387898.122713:0:7450:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787387898.126312:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787387898.126482:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787387898.126610:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787387898.126726:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787387898.126874:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787387898.127060:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787387898.127179:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787387898.127311:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000100:00100000:2.0:1787387898.128050:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a85de09c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1874211945587328:12345-0@lo:700: Request processed in 38619us (38943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387898.128070:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787387898.129435:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ed7a1b09 x1874211945587328/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787387914 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387898.129452:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed7a1b09 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874211945587328:0@lo:700: 40000000:02000000:0.0:1787387898.129465:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1787387898.134023:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1787387898.134219:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000337daf59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211945588096:12345-0@lo:1000: Request processed in 29701us (29743us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787387898.134234:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1787387898.134330:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787387898.134335:0:7476:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787387898.134394:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2662c26 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211945588096:0@lo:1000: 00000100:00100000:2.0:1787387898.134481:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2662c26 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211945588224:0@lo:1000: 00000100:00100000:2.0:1787387898.134618:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387898.134667:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e5895c69 going to sleep for 11 seconds 00000100:00100000:3.0:1787387898.134723:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945588224 00000100:00100000:3.0:1787387898.134730:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945588224 00000100:00100000:3.0:1787387898.134770:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387898.134777:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098a3fc51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211945588224:12345-0@lo:1000: 00000100:00100000:3.0:1787387898.134840:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098a3fc51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874211945588224:12345-0@lo:1000: Request processed in 65us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387898.134848:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387898.134914:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2662c26 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874211945588224:0@lo:1000: 00000040:00080000:2.0:1787387898.134930:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787387898.134957:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c96008be with version 1 00100000:10000000:1.0:1787387898.135339:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787387898.135553:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787387898.135729:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787387898.135876:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787387898.136027:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787387898.136159:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787387898.136291:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787387898.136469:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787387898.136792:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787387898.136920:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787387898.137079:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787387898.137231:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787387898.137447:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787387898.137584:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787387898.137711:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787387898.137863:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787387898.138014:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787387898.138147:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787387898.138276:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000040:00080000:2.0:1787387898.140574:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787387898.140662:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787387898.142669:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000008c0e85b9 version 1 rpc_version 1 00000020:00100000:3.0:1787387898.142709:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787387898.142719:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007968ce1e x1874211945588480/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787387898.142757:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007968ce1e pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1874211945588480:0@lo:1000: 00000100:00100000:3.0:1787387898.142820:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387898.142867:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f986df4d going to sleep for 11 seconds 00000100:00100000:0.0:1787387898.143093:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945588480 00000100:00100000:0.0:1787387898.143101:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945588480 00000100:00100000:0.0:1787387898.143149:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387898.143156:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed7a1b09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1874211945588480:12345-0@lo:1000: 00100000:10000000:1.0:1787387898.143815:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787387898.146582:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787387898.146751:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787387898.146882:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787387898.147031:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787387898.147246:0:7450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787387898.160470:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1787387898.162630:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed7a1b09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1874211945588480:12345-0@lo:1000: Request processed in 19468us (19803us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787387898.162645:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1787387898.162817:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787387898.162822:0:7466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787387898.162840:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007968ce1e pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1874211945588480:0@lo:1000: 00000040:00080000:3.0:1787387898.171870:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787387898.172598:0:7450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787387898.172639:0:7450:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa5d541c5f988 00100000:10000000:1.0:1787387898.172649:0:7450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787387898.179230:0:7450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787387898.179283:0:7450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787387898.179302:0:7450:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787387898.179335:0:7450:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787387898.188080:0:7450:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787387898.188299:0:7450:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1787387898.192654:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787387898.192714:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787387898.192717:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1787387898.487760:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387899.500442:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387900.524540:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387901.551430:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387902.573604:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387903.213536:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002c0704e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945588608:0@lo:41: 00000100:00100000:0.0:1787387903.213602:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387903.213680:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945588608 00000100:00100000:0.0:1787387903.213688:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945588608 00000100:00100000:0.0:1787387903.213737:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787387903.213745:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074ee84ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945588608:12345-0@lo:41: 00000004:00000024:0.0:1787387903.213786:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787387903.213828:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074ee84ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945588608:12345-0@lo:41: Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387903.213848:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787387903.213895:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002c0704e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945588608:0@lo:41: 00000100:00100000:0.0:1787387903.215646:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945588992:0@lo:400: 00000100:00100000:0.0:1787387903.215745:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387903.215799:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945588992 00000100:00100000:0.0:1787387903.215806:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945588992 00000100:00100000:0.0:1787387903.215845:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387903.215853:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ff9c024 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945588992:12345-0@lo:400: 00000100:00100000:0.0:1787387903.215901:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ff9c024 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945588992:12345-0@lo:400: Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387903.215913:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787387903.215950:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001eb9b026 x1874211945588992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387903.215962:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945588992:0@lo:400: 00000100:00100000:3.0:1787387903.216034:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002c0704e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945588736:0@lo:400: 00000100:00100000:3.0:1787387903.216070:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387903.216103:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387903.216109:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094eac07f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945588864:0@lo:400: 00000100:00100000:3.0:1787387903.216130:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387903.216496:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945588736 00000100:00100000:0.0:1787387903.216501:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945588736 00000100:00100000:0.0:1787387903.216532:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787387903.216537:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d579c451 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+13:3649:x1874211945588736:12345-0@lo:400: 00000100:00100000:0.0:1787387903.216572:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d579c451 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+13:3649:x1874211945588736:12345-0@lo:400: Request processed in 35us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387903.216579:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787387903.216604:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945588864 00000100:00100000:0.0:1787387903.216607:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945588864 00000100:00100000:0.0:1787387903.216627:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787387903.216633:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ced2e6da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945588864:12345-0@lo:400: 00000100:00100000:0.0:1787387903.216661:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ced2e6da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945588864:12345-0@lo:400: Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387903.216666:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787387903.216732:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000094eac07f x1874211945588864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387903.216742:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094eac07f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945588864:0@lo:400: 00000100:00100000:3.0:1787387903.216751:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002c0704e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945588736:0@lo:400: 00000001:02000400:3.0:1787387903.370084:0:7721:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787387903.596609:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787387904.271245:0:7773:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787387904.271603:0:7773:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787387904.625291:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787387905.260466:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787387905.260485:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b73aa7800 from 4 10000000:01000000:3.0:1787387905.260508:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787387905.260550:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a4474139 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387905.260562:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a4474139 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387905.260570:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a4474139 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387905.260593:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002a61f5e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945589120:0@lo:101: 00000100:00100000:3.0:1787387905.260658:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387905.260899:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000005656538e going to sleep for 11 seconds 00000100:00100000:0.0:1787387905.261039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945589120 00000100:00100000:0.0:1787387905.261047:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945589120 00000100:00100000:0.0:1787387905.261100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787387905.261108:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b533d272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+13:6518:x1874211945589120:12345-0@lo:101: 00010000:00010000:0.0:1787387905.261121:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387905.261133:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eaff4262/0x26817551a4474140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474139 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387905.261166:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eaff4262/0x26817551a4474140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474139 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387905.261176:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eaff4262/0x26817551a4474140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474139 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387905.261185:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eaff4262, rc 0) 00000100:00100000:0.0:1787387905.261235:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b533d272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:6518:x1874211945589120:12345-0@lo:101: Request processed in 128us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.261244:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787387905.261340:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002a61f5e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945589120:0@lo:101: 00010000:00010000:1.0:1787387905.261394:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a4474139 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387905.261402:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a4474139 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387905.261449:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ddf0823 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945589248:0@lo:256: 00000100:00100000:1.0:1787387905.261494:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.261513:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c7276232 going to sleep for 11 seconds 00000100:00100000:3.0:1787387905.261617:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945589248 00000100:00100000:3.0:1787387905.261621:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945589248 00000100:00100000:3.0:1787387905.261656:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787387905.261662:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000748824d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:6518:x1874211945589248:12345-0@lo:256: 20000000:01000000:3.0:1787387905.261676:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787387905.261693:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787387905.261696:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787387905.261913:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000748824d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:6518:x1874211945589248:12345-0@lo:256: Request processed in 251us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387905.261920:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787387905.261992:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ddf0823 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945589248:0@lo:256: 10000000:01000000:2.0:1787387905.262034:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787387905.262039:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a4474139 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387905.262047:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 000000009380cf87/0x26817551a4474139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387905.262055:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787387905.262057:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b46a34000 from 21 10000000:01000000:2.0:1787387905.262060:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387905.262078:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 0000000065ad8fef/0x26817551a4474147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387905.262090:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 0000000065ad8fef/0x26817551a4474147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387905.262097:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 0000000065ad8fef/0x26817551a4474147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387905.262109:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2662c26 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945589376:0@lo:101: 00000100:00100000:2.0:1787387905.262135:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387905.262155:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a34b0737 going to sleep for 11 seconds 00000100:00100000:1.0:1787387905.262208:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945589376 00000100:00100000:1.0:1787387905.262213:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945589376 00000100:00100000:1.0:1787387905.262232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787387905.262237:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de111b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:6518:x1874211945589376:12345-0@lo:101: 00010000:00010000:1.0:1787387905.262244:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387905.262253:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad7907b9/0x26817551a447414e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474147 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387905.262266:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad7907b9/0x26817551a447414e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474147 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387905.262273:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad7907b9/0x26817551a447414e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474147 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387905.262279:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad7907b9, rc 0) 00000100:00100000:1.0:1787387905.262325:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de111b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945589376:12345-0@lo:101: Request processed in 87us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387905.262330:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787387905.262416:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2662c26 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945589376:0@lo:101: 00010000:00010000:2.0:1787387905.262425:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 0000000065ad8fef/0x26817551a4474147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387905.262431:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 0000000065ad8fef/0x26817551a4474147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387905.262492:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2662c26 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945589504:0@lo:501: 00000100:00100000:2.0:1787387905.262521:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387905.262548:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a34b0737 going to sleep for 11 seconds 00000100:00100000:1.0:1787387905.262658:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945589504 00000100:00100000:1.0:1787387905.262663:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945589504 00000100:00100000:1.0:1787387905.262688:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787387905.262693:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000390bf232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945589504:12345-0@lo:501: 00000100:00100000:1.0:1787387905.262818:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000390bf232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945589504:12345-0@lo:501: Request processed in 124us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387905.262824:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787387905.262998:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2662c26 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945589504:0@lo:501: 00000100:00100000:2.0:1787387905.263025:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2662c26 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945589632:0@lo:503: 00000100:00100000:2.0:1787387905.263064:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387905.263084:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a34b0737 going to sleep for 11 seconds 00000100:00100000:3.0:1787387905.263141:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945589632 00000100:00100000:3.0:1787387905.263146:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945589632 00000100:00100000:3.0:1787387905.263175:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787387905.263180:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e0503e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945589632:12345-0@lo:503: 00000100:00100000:3.0:1787387905.263256:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e0503e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945589632:12345-0@lo:503: Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387905.263271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787387905.263445:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2662c26 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945589632:0@lo:503: 00000100:00100000:1.0:1787387905.270072:0:7825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bae718e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:7825:1874211945589760:0@lo:502: 00000100:00100000:1.0:1787387905.270163:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.270209:0:7825:0:(client.c:2702:ptlrpc_set_wait()) set 000000000cb01b83 going to sleep for 11 seconds 00000100:00100000:3.0:1787387905.271857:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945589760 00000100:00100000:3.0:1787387905.271882:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945589760 00000100:00100000:3.0:1787387905.271947:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787387905.271956:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cba140e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7825:x1874211945589760:12345-0@lo:502: 00000100:00100000:3.0:1787387905.272119:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cba140e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7825:x1874211945589760:12345-0@lo:502: Request processed in 164us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387905.272128:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787387905.272237:0:7825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bae718e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:7825:1874211945589760:0@lo:502: 00000100:00100000:1.0:1787387905.272310:0:7825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bae718e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:7825:1874211945589888:0@lo:502: 00000100:00100000:1.0:1787387905.272384:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.272412:0:7825:0:(client.c:2702:ptlrpc_set_wait()) set 000000000cb01b83 going to sleep for 11 seconds 00000100:00100000:0.0:1787387905.272482:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945589888 00000100:00100000:0.0:1787387905.272487:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945589888 00000100:00100000:0.0:1787387905.272520:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787387905.272526:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d3ffde2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7825:x1874211945589888:12345-0@lo:502: 00000100:00100000:0.0:1787387905.272607:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d3ffde2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:7825:x1874211945589888:12345-0@lo:502: Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.272614:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787387905.272763:0:7825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bae718e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:7825:1874211945589888:0@lo:502: 00000040:00080000:1.0:1787387905.272782:0:7825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787387905.273127:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787387905.273149:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787387905.273158:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 0000000065ad8fef/0x26817551a4474147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387905.273170:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 0000000065ad8fef/0x26817551a4474147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387905.273180:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787387905.273182:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b46a34000 from 4 10000000:01000000:0.0:1787387905.273185:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787387905.273215:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 000000008ebb02e9/0x26817551a4474155 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387905.273222:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 000000008ebb02e9/0x26817551a4474155 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387905.273229:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 000000008ebb02e9/0x26817551a4474155 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387905.273242:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945590016:0@lo:101: 00000100:00100000:0.0:1787387905.273275:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387905.273310:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000004dc14083 going to sleep for 11 seconds 00000100:00100000:3.0:1787387905.273378:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945590016 00000100:00100000:3.0:1787387905.273383:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945590016 00000100:00100000:3.0:1787387905.273416:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787387905.273423:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000220cc570 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945590016:12345-0@lo:101: 00010000:00010000:3.0:1787387905.273432:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387905.273443:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002983bc67/0x26817551a447415c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474155 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387905.273463:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002983bc67/0x26817551a447415c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474155 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387905.273481:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002983bc67/0x26817551a447415c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474155 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387905.273492:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002983bc67, rc 0) 00000100:00100000:3.0:1787387905.273530:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000220cc570 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945590016:12345-0@lo:101: Request processed in 108us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387905.273536:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787387905.273698:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945590016:0@lo:101: 00010000:00010000:0.0:1787387905.273709:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 000000008ebb02e9/0x26817551a4474155 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387905.273718:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 000000008ebb02e9/0x26817551a4474155 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387905.273772:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945590144:0@lo:256: 00000100:00100000:0.0:1787387905.273802:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387905.273830:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000004dc14083 going to sleep for 11 seconds 00000100:00100000:3.0:1787387905.274579:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945590144 00000100:00100000:3.0:1787387905.274587:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945590144 00000100:00100000:3.0:1787387905.274637:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787387905.274643:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000473b0048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945590144:12345-0@lo:256: 20000000:01000000:3.0:1787387905.274659:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787387905.274673:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787387905.274676:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787387905.274840:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000473b0048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945590144:12345-0@lo:256: Request processed in 196us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387905.274847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787387905.275197:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945590144:0@lo:256: 10000000:01000000:0.0:1787387905.275247:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787387905.275254:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000008ebb02e9/0x26817551a4474155 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387905.275262:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 000000008ebb02e9/0x26817551a4474155 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387905.275276:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787387905.275278:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787387905.275280:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787387905.275313:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387905.275319:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387905.275326:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387905.275339:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945590272:0@lo:101: 00000100:00100000:1.0:1787387905.276070:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.276106:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000004dc14083 going to sleep for 11 seconds 00000100:00100000:3.0:1787387905.276578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945590272 00000100:00100000:3.0:1787387905.276586:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945590272 00000100:00100000:3.0:1787387905.276635:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787387905.276643:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fb5ec60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945590272:12345-0@lo:101: 00010000:00010000:3.0:1787387905.276656:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387905.276670:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe1a6c7d/0x26817551a447416a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474163 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387905.276692:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe1a6c7d/0x26817551a447416a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474163 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387905.276701:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe1a6c7d/0x26817551a447416a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474163 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387905.276711:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe1a6c7d, rc 0) 00000100:00100000:3.0:1787387905.277304:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fb5ec60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945590272:12345-0@lo:101: Request processed in 653us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387905.277312:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787387905.277848:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945590272:0@lo:101: 00010000:00010000:1.0:1787387905.277865:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474163 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387905.277889:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474163 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387905.277961:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bae718e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945590400:0@lo:501: 00000100:00100000:1.0:1787387905.277992:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.278027:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000000cb01b83 going to sleep for 11 seconds 00000100:00100000:0.0:1787387905.278827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945590400 00000100:00100000:0.0:1787387905.278836:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945590400 00000100:00100000:0.0:1787387905.278965:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787387905.278974:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091301720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945590400:12345-0@lo:501: 00000100:00100000:0.0:1787387905.279119:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091301720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945590400:12345-0@lo:501: Request processed in 147us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.279127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787387905.279275:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bae718e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945590400:0@lo:501: 00000100:00100000:3.0:1787387905.279322:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e055cd3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945590528:0@lo:503: 00000100:00100000:3.0:1787387905.279397:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387905.285411:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945590528 00000100:00100000:2.0:1787387905.285440:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945590528 00000100:00100000:3.0:1787387905.285462:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000035e252d0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387905.285631:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787387905.285643:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbcb3a63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945590528:12345-0@lo:503: 00000100:00100000:0.0:1787387905.285798:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbcb3a63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945590528:12345-0@lo:503: Request processed in 159us (6401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.285806:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787387905.285891:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e055cd3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945590528:0@lo:503: 00000100:00100000:3.0:1787387905.286120:0:7826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e055cd3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:7826:1874211945590656:0@lo:502: 00000100:00100000:3.0:1787387905.286163:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387905.290795:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945590656 00000100:00100000:0.0:1787387905.290812:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945590656 00000100:00100000:3.0:1787387905.290838:0:7826:0:(client.c:2702:ptlrpc_set_wait()) set 00000000452e55e5 going to sleep for 11 seconds 00000100:00100000:0.0:1787387905.290880:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787387905.290887:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059ea9dc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:7826:x1874211945590656:12345-0@lo:502: 00000100:00100000:0.0:1787387905.291155:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059ea9dc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:7826:x1874211945590656:12345-0@lo:502: Request processed in 269us (4993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.291161:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787387905.292704:0:7826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e055cd3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:7826:1874211945590656:0@lo:502: 00000020:01000000:1.0:1787387905.292813:0:7826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387905.292827:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387905.292830:0:7826:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787387905.292835:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787387905.292838:0:7826:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:00000080:1.0:1787387905.292860:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387905.292977:0:7826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000005c4f207a) 00000020:00000080:1.0:1787387905.293002:0:7826:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1787387905.293010:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787387905.293103:0:7826:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787387905.293109:0:7826:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787387905.293116:0:7826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a4474178 00010000:00080000:1.0:1787387905.293145:0:7826:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000122a1249@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:1.0:1787387905.296535:0:7826:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1787387905.297782:0:7826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787387905.297796:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787387905.297829:0:7826:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787387905.297848:0:7826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a447417f 00000100:00080000:3.0:1787387905.297857:0:7826:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787387905.297862:0:7826:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000122a1249 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787387905.297906:0:7826:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c8d080fd x1874211945590784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787387905.297934:0:7826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1787387905.297971:0:7826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1787387905.298226:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387905.298239:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945590912:0@lo:400: 00000100:00100000:0.0:1787387905.298310:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387905.298366:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002c0704e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945591040:0@lo:400: 00000100:00100000:0.0:1787387905.298408:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387905.298426:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387905.298430:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094eac07f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945591168:0@lo:400: 00000100:00100000:0.0:1787387905.298448:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387905.298483:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945590912 00000100:00100000:0.0:1787387905.298489:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945590912 00000100:00100000:0.0:1787387905.298522:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945591168 00000100:00100000:0.0:1787387905.298525:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945591168 00000100:00100000:0.0:1787387905.298537:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787387905.298542:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fad3d4ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945590912:12345-0@lo:400: 00000100:00100000:0.0:1787387905.298586:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fad3d4ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945590912:12345-0@lo:400: Request processed in 43us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.298593:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787387905.298607:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387905.298613:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3747036 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945591168:12345-0@lo:400: 00000100:00100000:0.0:1787387905.298640:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3747036 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945591168:12345-0@lo:400: Request processed in 28us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.298646:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387905.298671:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945591040 00000100:00100000:0.0:1787387905.298675:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945591040 00000100:00100000:0.0:1787387905.298699:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787387905.298704:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b7eca48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945591040:12345-0@lo:400: 00000100:00100000:0.0:1787387905.298746:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b7eca48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945591040:12345-0@lo:400: Request processed in 42us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.298753:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787387905.298790:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000094eac07f x1874211945591168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387905.298803:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094eac07f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945591168:0@lo:400: 00000100:00100000:0.0:1787387905.298812:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002c0704e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945591040:0@lo:400: 00010000:00080000:0.0:1787387905.298842:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001eb9b026 x1874211945590912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387905.298850:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945590912:0@lo:400: 00000100:00100000:2.0:1787387905.299174:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c8d080fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945590784:0@lo:38: 00000100:00100000:2.0:1787387905.299211:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387905.299309:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945590784 00000100:00100000:0.0:1787387905.299314:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945590784 00000100:00100000:0.0:1787387905.299554:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387905.299559:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2662c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1874211945590784:12345-0@lo:38: 00010000:00080000:0.0:1787387905.299580:0:6526:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1787387905.299612:0:6526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a4474186 00000004:00100000:0.0:1787387905.299626:0:6526:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787387905.299630:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787387905.299830:0:7829:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000001eb9b026 x1874211945591296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387905.299839:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 0000000031c662f3 going to sleep for 0 seconds 00000020:01000000:3.0:1787387905.300273:0:7826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387905.300280:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387905.300282:0:7826:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787387905.300285:0:7826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387905.300289:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387905.300290:0:7826:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787387905.300305:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787387905.300307:0:7826:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787387905.300328:0:7826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067e53238 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:7826:1874211945591424:0@lo:502: 00000100:00100000:3.0:1787387905.300416:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387905.300446:0:7826:0:(client.c:2702:ptlrpc_set_wait()) set 0000000098bdf128 going to sleep for 11 seconds 00000100:00100000:1.0:1787387905.300591:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945591424 00000100:00100000:1.0:1787387905.300597:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945591424 00000100:00100000:1.0:1787387905.300628:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787387905.300635:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000527d967 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:7826:x1874211945591424:12345-0@lo:502: 00000100:00100000:1.0:1787387905.300763:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000527d967 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:7826:x1874211945591424:12345-0@lo:502: Request processed in 129us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387905.300771:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787387905.300913:0:7826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067e53238 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:7826:1874211945591424:0@lo:502: 00000020:01000000:3.0:1787387905.300944:0:7826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387905.300949:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387905.300950:0:7826:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787387905.300953:0:7826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787387905.301092:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787387905.301114:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787387905.301122:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474163 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387905.301132:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000da84595f/0x26817551a4474163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387905.301152:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787387905.301154:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff996b72b819c0 from 1 10000000:01000000:1.0:1787387905.301157:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787387905.301179:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 000000003d433a83/0x26817551a447418d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387905.301187:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 000000003d433a83/0x26817551a447418d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387905.301194:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 000000003d433a83/0x26817551a447418d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387905.301206:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087bb79ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945591552:0@lo:101: 00000100:00100000:1.0:1787387905.301244:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.301430:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000000cb01b83 going to sleep for 11 seconds 00000100:00100000:3.0:1787387905.301583:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945591552 00000100:00100000:3.0:1787387905.301589:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945591552 00000100:00100000:2.0:1787387905.301822:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787387905.301830:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce1cf001 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945591552:12345-0@lo:101: 00010000:00010000:2.0:1787387905.301840:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387905.301851:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035a6d666/0x26817551a4474194 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447418d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387905.301870:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035a6d666/0x26817551a4474194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447418d expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387905.301880:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035a6d666/0x26817551a4474194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447418d expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387905.301889:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035a6d666, rc 0) 00000100:00100000:2.0:1787387905.301962:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce1cf001 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945591552:12345-0@lo:101: Request processed in 134us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387905.301969:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787387905.302034:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087bb79ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945591552:0@lo:101: 00010000:00010000:3.0:1787387905.302046:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 000000003d433a83/0x26817551a447418d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387905.302053:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 000000003d433a83/0x26817551a447418d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387905.302103:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067e53238 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945591680:0@lo:501: 00000100:00100000:3.0:1787387905.302130:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387905.302152:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000098bdf128 going to sleep for 11 seconds 00000100:00100000:0.0:1787387905.302200:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945591680 00000100:00100000:0.0:1787387905.302205:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945591680 00000100:00100000:0.0:1787387905.302265:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787387905.302272:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d773077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945591680:12345-0@lo:501: 00000100:00100000:0.0:1787387905.302380:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d773077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945591680:12345-0@lo:501: Request processed in 109us (250us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787387905.302388:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787387905.302463:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067e53238 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945591680:0@lo:501: 10000000:01000000:3.0:1787387905.302559:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787387905.302564:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000003d433a83/0x26817551a447418d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387905.302571:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 000000003d433a83/0x26817551a447418d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787387905.315148:0:6526:0:(import.c:65:import_set_state_nolock()) 000000004db7535e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387905.315249:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2662c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874211945590784:12345-0@lo:38: Request processed in 15687us (16037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.315261:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387905.315403:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787387905.315413:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787387905.315422:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787387905.315427:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787387905.315429:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000122a1249 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787387905.315444:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000031c662f3): req@000000001eb9b026 x1874211945591296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387905.315469:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c8d080fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945590784:0@lo:38: 00000100:00100000:1.0:1787387905.315596:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.315625:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 0000000031c662f3 going to sleep for 11 seconds 00000100:00100000:2.0:1787387905.315689:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945591296 00000100:00100000:2.0:1787387905.315702:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945591296 00000100:00100000:2.0:1787387905.315756:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387905.315764:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d0d3195 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874211945591296:12345-0@lo:1000: 00000100:00100000:2.0:1787387905.315850:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d0d3195 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874211945591296:12345-0@lo:1000: Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387905.315857:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787387905.316096:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001eb9b026 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945591296:0@lo:1000: 00000040:01000000:1.0:1787387905.316124:0:7829:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787387905.316163:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945591808:0@lo:1000: 00000100:00100000:1.0:1787387905.316196:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.316215:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 0000000035e252d0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387905.316656:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002c0704e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945591936:0@lo:41: 00000100:00100000:1.0:1787387905.316687:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387905.316821:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945591808 00000100:00100000:0.0:1787387905.316826:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945591808 00000100:00100000:0.0:1787387905.316847:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945591936 00000100:00100000:0.0:1787387905.316850:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945591936 00000100:00100000:0.0:1787387905.316865:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387905.316871:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e1f67c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7829:x1874211945591808:12345-0@lo:1000: 00000100:00100000:0.0:1787387905.316981:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e1f67c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7829:x1874211945591808:12345-0@lo:1000: Request processed in 110us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.316987:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787387905.317001:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787387905.317007:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007e757a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1874211945591936:12345-0@lo:41: 00000004:00000024:0.0:1787387905.317027:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787387905.317108:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007e757a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1874211945591936:12345-0@lo:41: Request processed in 101us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.317114:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787387905.317220:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945591808:0@lo:1000: 00000100:00100000:1.0:1787387905.317262:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945592064:0@lo:700: 00000100:00100000:1.0:1787387905.317307:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.317330:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 0000000035e252d0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387905.317392:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002c0704e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945591936:0@lo:41: 00000100:00100000:0.0:1787387905.318049:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945592064 00000100:00100000:0.0:1787387905.318056:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945592064 00000100:00100000:0.0:1787387905.318114:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387905.318120:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e35bfd0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874211945592064:12345-0@lo:700: 00000100:00100000:0.0:1787387905.318178:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e35bfd0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874211945592064:12345-0@lo:700: Request processed in 58us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.318184:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387905.318260:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945592064:0@lo:700: 00000100:00100000:1.0:1787387905.318540:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945592192:0@lo:1000: 00000100:00100000:1.0:1787387905.318570:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.318585:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 000000007bec316f going to sleep for 11 seconds 00000100:00100000:0.0:1787387905.318713:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945592192 00000100:00100000:0.0:1787387905.318718:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945592192 00000100:00100000:0.0:1787387905.318813:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787387905.318819:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004493bf12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7829:x1874211945592192:12345-0@lo:1000: 00000100:00100000:0.0:1787387905.318877:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004493bf12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7829:x1874211945592192:12345-0@lo:1000: Request processed in 59us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.318884:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787387905.318979:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945592192:0@lo:1000: 00000004:00080000:1.0:1787387905.319024:0:7829:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000035e252d0 with version 0 00000020:00100000:1.0:1787387905.319038:0:7829:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787387905.319043:0:7829:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000ba66715 x1874211945592448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787387905.319055:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945592448:0@lo:1000: 00000100:00100000:1.0:1787387905.319091:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.319111:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 000000005b6a10d1 going to sleep for 11 seconds 00000100:00100000:0.0:1787387905.319184:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945592448 00000100:00100000:0.0:1787387905.319188:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945592448 00000100:00100000:0.0:1787387905.319217:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787387905.319223:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e006a7d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7829:x1874211945592448:12345-0@lo:1000: 00000001:00080000:3.0:1787387905.321059:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1787387905.321072:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787387905.321272:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e006a7d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7829:x1874211945592448:12345-0@lo:1000: Request processed in 2048us (2179us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787387905.321285:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787387905.322684:0:7829:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787387905.322692:0:7829:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787387905.322708:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945592448:0@lo:1000: 00000100:00100000:1.0:1787387905.325686:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945592576:0@lo:1000: 00000100:00100000:1.0:1787387905.325759:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387905.325860:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 000000002c54d06c going to sleep for 11 seconds 00000100:00100000:0.0:1787387905.327754:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945592576 00000100:00100000:0.0:1787387905.327767:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945592576 00000100:00100000:0.0:1787387905.327881:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787387905.327891:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087bb79ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7829:x1874211945592576:12345-0@lo:1000: 00000100:00100000:0.0:1787387905.328011:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087bb79ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7829:x1874211945592576:12345-0@lo:1000: Request processed in 123us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387905.328020:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787387905.328084:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874211945592576:0@lo:1000: 00000040:00080000:1.0:1787387905.328112:0:7829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787387905.328149:0:7829:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000005b6a10d1 with version 1 00000040:00080000:1.0:1787387905.330012:0:7829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787387905.330108:0:7829:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787387905.330127:0:7829:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:2.0:1787387905.330595:0:7827:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f445875d version 1 rpc_version 1 00000020:00100000:2.0:1787387905.330631:0:7827:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787387905.330640:0:7827:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000759f4071 x1874211945592832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787387905.330659:0:7827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000759f4071 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7827:1874211945592832:0@lo:1000: 00000100:00100000:2.0:1787387905.330717:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387905.330964:0:7827:0:(client.c:2702:ptlrpc_set_wait()) set 000000006e5afc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387905.331000:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945592832 00000100:00100000:3.0:1787387905.331013:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945592832 00000100:00100000:3.0:1787387905.331047:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787387905.331053:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034b3febe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7827:x1874211945592832:12345-0@lo:1000: 00000001:00080000:2.0:1787387905.332406:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1787387905.332860:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034b3febe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7827:x1874211945592832:12345-0@lo:1000: Request processed in 1805us (2141us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787387905.332870:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1787387905.332964:0:7827:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787387905.332968:0:7827:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787387905.332981:0:7827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000759f4071 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7827:1874211945592832:0@lo:1000: 00010000:00010000:3.0:1787387905.645927:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387906.669612:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787387907.116923:0:7879:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787387907.117216:0:7879:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787387907.692850:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787387908.253794:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffffdf0fd70 00000020:00000080:1.0:1787387908.253809:0:7927:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787387908.253814:0:7927:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787387908.253833:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffdf12000 20000000:00000080:1.0:1787387908.253841:0:7927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996b74e66c00 uarg=0000000000000000 20000000:01000000:1.0:1787387908.253880:0:7927:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787387908.253885:0:7927:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787387908.253890:0:7927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787387908.253963:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787387908.253974:0:7927:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787387908.258634:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387908.258857:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787387908.258889:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787387908.258906:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787387908.258922:0:7927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787387908.258939:0:7927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387908.258957:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d4be3558/0x26817551a447401a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474013 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387908.258964:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f1a82e7f/0x26817551a4474108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474101 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387908.258970:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387908.259004:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f1a82e7f/0x26817551a4474108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474101 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387908.259016:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f1a82e7f/0x26817551a4474108 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474101 expref: 17 pid: 6516 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387908.259035:0:7927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874211945592960:0@lo:104: 00000100:00100000:1.0:1787387908.259097:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387908.259216:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d4be3558/0x26817551a447401a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474013 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387908.259224:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d4be3558/0x26817551a447401a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474013 expref: 17 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387908.259232:0:7927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bae718e1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874211945593088:0@lo:104: 00000100:00100000:1.0:1787387908.259322:0:7927:0:(client.c:2702:ptlrpc_set_wait()) set 000000007bec316f going to sleep for 11 seconds 00000100:00100000:0.0:1787387908.259811:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787387908.259834:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387908.259860:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945592960 00000100:00100000:0.0:1787387908.259867:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945592960 00000100:00100000:0.0:1787387908.259894:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945593088 00000100:00100000:0.0:1787387908.259895:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945593088 00000100:00100000:0.0:1787387908.259906:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387908.259911:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001058ddb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+4:7927:x1874211945592960:12345-0@lo:104: 00010000:00010000:0.0:1787387908.259921:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.259973:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787387908.259978:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001058ddb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+4:7927:x1874211945592960:12345-0@lo:104: Request processed in 67us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387908.259984:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387908.260018:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787387908.260023:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094eac07f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:7927:x1874211945593088:12345-0@lo:104: 00010000:00010000:0.0:1787387908.260029:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260054:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787387908.260057:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094eac07f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:7927:x1874211945593088:12345-0@lo:104: Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387908.260062:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787387908.260074:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387908.260078:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260085:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000045c8bf1 already unused, calling callback (00000000c551f855) 10000000:00010000:0.0:1787387908.260087:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260099:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387908.260105:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387908.260111:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787387908.260135:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260141:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387908.260155:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260160:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 00000000045c8bf1/0x26817551a4474101 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474108 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260171:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387908.260173:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260178:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079142457 already unused, calling callback (00000000c551f855) 10000000:00010000:0.0:1787387908.260179:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260185:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387908.260190:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387908.260200:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787387908.260210:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260215:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387908.260224:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260229:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a4474013 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447401a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260241:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387908.260242:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387908.260243:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387908.260247:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387908.260267:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009716376e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945593216:0@lo:103: 00000100:00100000:0.0:1787387908.260298:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387908.260330:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089f2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945593344:0@lo:103: 00000100:00100000:0.0:1787387908.260367:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387908.260393:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945593216 00000100:00100000:0.0:1787387908.260396:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945593216 00010000:00010000:0.0:1787387908.260407:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f1a82e7f/0x26817551a4474108 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474101 expref: 18 pid: 6516 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387908.260423:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945593344 00000100:00100000:0.0:1787387908.260425:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945593344 00010000:00010000:0.0:1787387908.260432:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d4be3558/0x26817551a447401a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474013 expref: 19 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387908.260467:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387908.260473:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f33e3977 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:3652:x1874211945593216:12345-0@lo:103: 00010000:00010000:0.0:1787387908.260482:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387908.260618:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f1a82e7f/0x26817551a4474108 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474101 expref: 19 pid: 6516 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260630:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f1a82e7f/0x26817551a4474108 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474101 expref: 19 pid: 6516 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260644:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387908.260668:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f33e3977 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:3652:x1874211945593216:12345-0@lo:103: Request processed in 197us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387908.260674:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787387908.260685:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787387908.260690:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099ccacdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3649:x1874211945593344:12345-0@lo:103: 00010000:00010000:0.0:1787387908.260696:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387908.260699:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d4be3558/0x26817551a447401a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474013 expref: 18 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260706:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d4be3558/0x26817551a447401a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474013 expref: 18 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260715:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260721:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260740:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260746:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260751:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260755:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260760:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000921300de already unused, calling callback (000000003b559001) 00010000:00010000:0.0:1787387908.260763:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260769:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260775:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387908.260781:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387908.260801:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099ccacdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3649:x1874211945593344:12345-0@lo:103: Request processed in 112us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387908.260806:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787387908.260839:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089f2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945593344:0@lo:103: 00000100:00100000:0.0:1787387908.260855:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009716376e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945593216:0@lo:103: 00010000:00010000:2.0:1787387908.260919:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f1a82e7f/0x26817551a4474108 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474101 expref: 17 pid: 6516 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387908.260929:0:7927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000ba66715 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874211945592960:0@lo:104: 00010000:00010000:2.0:1787387908.260935:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4be3558/0x26817551a447401a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474013 expref: 16 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387908.260942:0:7927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bae718e1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874211945593088:0@lo:104: 00010000:00010000:2.0:1787387908.260953:0:7927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387908.260969:0:7927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387908.260975:0:7927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387908.260980:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000921300de/0x26817551a447419b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387908.333546:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ddf0823 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945593472:0@lo:41: 00000100:00100000:2.0:1787387908.333615:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387908.333720:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945593472 00000100:00100000:1.0:1787387908.333728:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945593472 00000100:00100000:1.0:1787387908.333777:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787387908.333785:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000759f4071 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945593472:12345-0@lo:41: 00000004:00000024:1.0:1787387908.333818:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787387908.333858:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000759f4071 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945593472:12345-0@lo:41: Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387908.333865:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787387908.333903:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ddf0823 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945593472:0@lo:41: 00010000:00010000:0.0:1787387908.716492:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387909.743073:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387910.384282:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387910.384305:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000043c74626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945593600:0@lo:41: 00000100:00100000:1.0:1787387910.384389:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387910.384506:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945593600 00000100:00100000:2.0:1787387910.384514:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945593600 00000100:00100000:2.0:1787387910.384563:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787387910.384570:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ddf0823 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945593600:12345-0@lo:41: 00000004:00000024:2.0:1787387910.384604:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787387910.384648:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ddf0823 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945593600:12345-0@lo:41: Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387910.384656:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787387910.384695:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000043c74626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945593600:0@lo:41: 00000100:00100000:1.0:1787387910.403738:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945593984:0@lo:400: 00000100:00100000:1.0:1787387910.403805:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387910.403850:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387910.403855:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8e38d03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945593856:0@lo:400: 00000100:00100000:1.0:1787387910.403907:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387910.403936:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945593856 00000100:00100000:1.0:1787387910.403942:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945593856 00000100:00100000:1.0:1787387910.403985:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387910.403991:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bae718e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945593856:12345-0@lo:400: 00000100:00100000:1.0:1787387910.404050:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bae718e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945593856:12345-0@lo:400: Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387910.404057:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787387910.404081:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945593984 00000100:00100000:1.0:1787387910.404084:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945593984 00000100:00100000:1.0:1787387910.404105:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787387910.404110:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000352aa214 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945593984:12345-0@lo:400: 00000100:00100000:1.0:1787387910.404135:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000352aa214 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945593984:12345-0@lo:400: Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387910.404141:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787387910.404170:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d8e38d03 x1874211945593856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387910.404183:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8e38d03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945593856:0@lo:400: 00000100:00100000:1.0:1787387910.404192:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945593984:0@lo:400: 00000100:00100000:3.0:1787387910.404366:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd5fb2d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945594112:0@lo:400: 00000100:00100000:3.0:1787387910.404395:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387910.404420:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387910.404426:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df32f4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945593728:0@lo:400: 00000100:00100000:3.0:1787387910.404452:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387910.404479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945593728 00000100:00100000:3.0:1787387910.404483:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945593728 00000100:00100000:3.0:1787387910.404508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787387910.404513:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044c07a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:3651:x1874211945593728:12345-0@lo:400: 00000100:00100000:3.0:1787387910.404544:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044c07a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:3651:x1874211945593728:12345-0@lo:400: Request processed in 31us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387910.404550:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787387910.404579:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df32f4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945593728:0@lo:400: 00000100:00100000:1.0:1787387910.404886:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945594112 00000100:00100000:1.0:1787387910.404891:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945594112 00000100:00100000:1.0:1787387910.404914:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787387910.404919:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067e53238 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945594112:12345-0@lo:400: 00000100:00100000:1.0:1787387910.404951:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067e53238 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945594112:12345-0@lo:400: Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387910.404957:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787387910.405033:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bd5fb2d9 x1874211945594112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387910.405054:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd5fb2d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945594112:0@lo:400: 00010000:00010000:1.0:1787387910.765680:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387911.795554:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387912.824908:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387913.452604:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945594240:0@lo:41: 00000100:00100000:1.0:1787387913.452698:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387913.452795:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945594240 00000100:00100000:1.0:1787387913.452805:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945594240 00000100:00100000:1.0:1787387913.452853:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787387913.452861:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8e38d03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945594240:12345-0@lo:41: 00000004:00000024:1.0:1787387913.453013:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787387913.453059:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8e38d03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945594240:12345-0@lo:41: Request processed in 198us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387913.453066:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787387913.453115:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945594240:0@lo:41: 00010000:00010000:3.0:1787387913.840129:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387914.876956:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787387915.000490:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787387915.000500:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b73aa7800 from 1 10000000:01000000:0.0:1787387915.000505:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387915.000551:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a44741a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387915.000564:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a44741a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387915.000573:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a44741a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387915.000596:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009716376e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945594368:0@lo:101: 00000100:00100000:0.0:1787387915.000661:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387915.000712:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000003b85c4e6 going to sleep for 11 seconds 00000100:00100000:1.0:1787387915.000818:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945594368 00000100:00100000:1.0:1787387915.000828:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945594368 00000100:00100000:1.0:1787387915.000883:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387915.000892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009405cc9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945594368:12345-0@lo:101: 00010000:00010000:1.0:1787387915.000906:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387915.000918:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000863f19ef/0x26817551a44741a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44741a2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387915.000942:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000863f19ef/0x26817551a44741a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44741a2 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387915.000951:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000863f19ef/0x26817551a44741a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44741a2 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387915.000959:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000863f19ef, rc 0) 00000100:00100000:1.0:1787387915.001000:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009405cc9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945594368:12345-0@lo:101: Request processed in 110us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387915.001017:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387915.001103:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009716376e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945594368:0@lo:101: 00010000:00010000:1.0:1787387915.001117:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a44741a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387915.001125:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 0000000079142457/0x26817551a44741a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387915.001185:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945594496:0@lo:501: 00000100:00100000:1.0:1787387915.001211:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387915.001245:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000095f5a7d7 going to sleep for 11 seconds 00000100:00100000:1.0:1787387915.001258:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945594496 00000100:00100000:1.0:1787387915.001262:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945594496 00000100:00100000:1.0:1787387915.001284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787387915.001290:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002079e822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945594496:12345-0@lo:501: 00000100:00100000:1.0:1787387915.001415:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002079e822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945594496:12345-0@lo:501: Request processed in 124us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387915.001422:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787387915.001453:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945594496:0@lo:501: 00000100:00100000:1.0:1787387915.001482:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945594624:0@lo:503: 00000100:00100000:1.0:1787387915.001523:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387915.001543:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000095f5a7d7 going to sleep for 11 seconds 00000100:00100000:1.0:1787387915.001556:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945594624 00000100:00100000:1.0:1787387915.001560:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945594624 00000100:00100000:1.0:1787387915.001584:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787387915.001590:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c379fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945594624:12345-0@lo:503: 00000100:00100000:1.0:1787387915.005640:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c379fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945594624:12345-0@lo:503: Request processed in 4041us (4108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387915.005660:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787387915.008804:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c4a9ab6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945594624:0@lo:503: 00000100:00100000:3.0:1787387915.024301:0:8174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e13c9c25 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8174:1874211945594752:0@lo:502: 00000100:00100000:3.0:1787387915.024440:0:8174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387915.024476:0:8174:0:(client.c:2702:ptlrpc_set_wait()) set 0000000097a4d27f going to sleep for 11 seconds 00000100:00100000:0.0:1787387915.024585:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945594752 00000100:00100000:0.0:1787387915.024594:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945594752 00000100:00100000:0.0:1787387915.024649:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787387915.024658:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000172dd9c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:8174:x1874211945594752:12345-0@lo:502: 00000100:00100000:0.0:1787387915.024797:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000172dd9c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:8174:x1874211945594752:12345-0@lo:502: Request processed in 139us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387915.024805:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787387915.031127:0:8174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e13c9c25 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8174:1874211945594752:0@lo:502: 00000020:01000000:3.0:1787387915.031169:0:8174:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387915.031179:0:8174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387915.031182:0:8174:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787387915.031189:0:8174:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b73aa7800 00000020:00000080:3.0:1787387915.031192:0:8174:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787387915.031255:0:8174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8174:1874211945594880:0@lo:502: 00000100:00100000:3.0:1787387915.031324:0:8174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387915.031394:0:8174:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787387915.032308:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945594880 00000100:00100000:2.0:1787387915.032316:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945594880 00000100:00100000:2.0:1787387915.032392:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787387915.032401:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:8174:x1874211945594880:12345-0@lo:502: 00000100:00100000:2.0:1787387915.032532:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:8174:x1874211945594880:12345-0@lo:502: Request processed in 132us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387915.032539:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787387915.033468:0:8174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8174:1874211945594880:0@lo:502: 00000020:01000000:1.0:1787387915.033499:0:8174:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387915.033514:0:8174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387915.033516:0:8174:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787387915.033520:0:8174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787387915.033887:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787387915.033912:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387915.033921:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b40031400/0x26817551a44741a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387915.033934:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b40031400/0x26817551a44741a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387915.033952:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787387915.033954:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b46a34000 from 1 10000000:01000000:0.0:1787387915.033957:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387915.033986:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387915.033995:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387915.034003:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387915.034021:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945595008:0@lo:101: 00000100:00100000:0.0:1787387915.034075:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387915.034108:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5dc4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387915.034124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945595008 00000100:00100000:0.0:1787387915.034129:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945595008 00000100:00100000:0.0:1787387915.034167:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787387915.034174:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945595008:12345-0@lo:101: 00010000:00010000:0.0:1787387915.034184:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387915.034196:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b40031200/0x26817551a44741b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44741b0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387915.034218:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40031200/0x26817551a44741b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44741b0 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387915.034239:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b40031200/0x26817551a44741b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44741b0 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387915.034257:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031200, rc 0) 00000100:00100000:0.0:1787387915.034300:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945595008:12345-0@lo:101: Request processed in 126us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387915.034307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787387915.034982:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945595008:0@lo:101: 00010000:00010000:3.0:1787387915.034996:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387915.035005:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387915.035059:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945595136:0@lo:501: 00000100:00100000:3.0:1787387915.035104:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387915.035132:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387915.035485:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945595136 00000100:00100000:0.0:1787387915.035490:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945595136 00000100:00100000:0.0:1787387915.035519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787387915.035526:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945595136:12345-0@lo:501: 00000100:00100000:0.0:1787387915.035635:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945595136:12345-0@lo:501: Request processed in 109us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387915.035642:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787387915.038711:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945595136:0@lo:501: 00000100:00100000:3.0:1787387915.038785:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945595264:0@lo:503: 00000100:00100000:3.0:1787387915.038852:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387915.038896:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387915.038949:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945595264 00000100:00100000:2.0:1787387915.038957:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945595264 00000100:00100000:2.0:1787387915.039010:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787387915.039020:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945595264:12345-0@lo:503: 00000100:00100000:2.0:1787387915.039137:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945595264:12345-0@lo:503: Request processed in 118us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387915.039144:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787387915.039315:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945595264:0@lo:503: 00000100:00100000:3.0:1787387915.050975:0:8175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8175:1874211945595392:0@lo:502: 00000100:00100000:3.0:1787387915.051455:0:8175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387915.051547:0:8175:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787387915.056880:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945595392 00000100:00100000:2.0:1787387915.056902:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945595392 00000100:00100000:2.0:1787387915.056977:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787387915.056988:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:8175:x1874211945595392:12345-0@lo:502: 00000100:00100000:2.0:1787387915.057163:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:8175:x1874211945595392:12345-0@lo:502: Request processed in 177us (6100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387915.057171:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787387915.058103:0:8175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8175:1874211945595392:0@lo:502: 00000020:01000000:3.0:1787387915.058141:0:8175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387915.058152:0:8175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387915.058155:0:8175:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787387915.058163:0:8175:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b46a34000 00000020:00000080:3.0:1787387915.058165:0:8175:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787387915.058200:0:8175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8175:1874211945595520:0@lo:502: 00000100:00100000:3.0:1787387915.058263:0:8175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387915.058299:0:8175:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787387915.060340:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945595520 00000100:00100000:2.0:1787387915.060377:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945595520 00000100:00100000:2.0:1787387915.060436:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787387915.060446:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:8175:x1874211945595520:12345-0@lo:502: 00000100:00100000:2.0:1787387915.060608:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:8175:x1874211945595520:12345-0@lo:502: Request processed in 163us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387915.060616:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787387915.061268:0:8175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8175:1874211945595520:0@lo:502: 00000020:01000000:3.0:1787387915.061312:0:8175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387915.061322:0:8175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387915.061325:0:8175:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787387915.061329:0:8175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787387915.061765:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787387915.061799:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387915.061809:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387915.061821:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387915.500624:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387915.500650:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945595648:0@lo:41: 00000100:00100000:2.0:1787387915.500718:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387915.500785:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945595648 00000100:00100000:2.0:1787387915.500793:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945595648 00000100:00100000:2.0:1787387915.500839:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787387915.500847:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945595648:12345-0@lo:41: 00000004:00000024:2.0:1787387915.500878:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787387915.500919:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945595648:12345-0@lo:41: Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387915.500926:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787387915.500970:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945595648:0@lo:41: 00000100:00100000:2.0:1787387915.510112:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945595776:0@lo:400: 00000100:00100000:2.0:1787387915.510197:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387915.510263:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387915.510270:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945596160:0@lo:400: 00000100:00100000:2.0:1787387915.510297:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387915.510342:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945596160 00000100:00100000:2.0:1787387915.510369:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945596160 00000100:00100000:2.0:1787387915.510417:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387915.510426:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945596160:12345-0@lo:400: 00000100:00100000:2.0:1787387915.510477:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945596160:12345-0@lo:400: Request processed in 52us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387915.510485:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787387915.510525:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b7389f800 x1874211945596160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387915.510552:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945596160:0@lo:400: 00000100:00100000:1.0:1787387915.510853:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945595904:0@lo:400: 00000100:00100000:1.0:1787387915.510884:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387915.510909:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387915.510915:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945596032:0@lo:400: 00000100:00100000:1.0:1787387915.510939:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387915.511010:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945595904 00000100:00100000:2.0:1787387915.511015:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945595904 00000100:00100000:2.0:1787387915.511048:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387915.511055:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945595904:12345-0@lo:400: 00000100:00100000:2.0:1787387915.511094:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945595904:12345-0@lo:400: Request processed in 39us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387915.511100:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787387915.511130:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b7389ca80 x1874211945595904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387915.511139:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945595904:0@lo:400: 00000100:00100000:2.0:1787387915.511157:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945596032 00000100:00100000:2.0:1787387915.511160:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945596032 00000100:00100000:2.0:1787387915.511182:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387915.511188:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945596032:12345-0@lo:400: 00000100:00100000:2.0:1787387915.511222:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945596032:12345-0@lo:400: Request processed in 34us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387915.511240:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787387915.511266:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945596032:0@lo:400: 00000100:00100000:0.0:1787387915.511340:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945595776 00000100:00100000:0.0:1787387915.511375:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945595776 00000100:00100000:0.0:1787387915.511406:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787387915.511412:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3650:x1874211945595776:12345-0@lo:400: 00000100:00100000:0.0:1787387915.511449:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3650:x1874211945595776:12345-0@lo:400: Request processed in 38us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387915.511455:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787387915.512303:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945595776:0@lo:400: 00010000:00010000:0.0:1787387915.885943:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387916.910253:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387917.945316:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387918.576031:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945596288:0@lo:41: 00000100:00100000:1.0:1787387918.576101:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387918.577422:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945596288 00000100:00100000:0.0:1787387918.577432:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945596288 00000100:00100000:0.0:1787387918.577477:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787387918.577487:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945596288:12345-0@lo:41: 00000004:00000024:0.0:1787387918.577519:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787387918.579560:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945596288:12345-0@lo:41: Request processed in 2066us (3451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387918.579583:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787387918.580060:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945596288:0@lo:41: 00010000:00010000:1.0:1787387918.982645:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387919.986097:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787387920.246784:0:8428:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787387920.246788:0:8428:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787387920.246790:0:8428:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787387920.251379:0:8428:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff996b74ea1800 00000020:01000004:1.0:1787387920.251399:0:8428:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787387920.251411:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787387920.251424:0:8428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff996b7bdfcd40) 00000020:00000080:1.0:1787387920.251441:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787387920.351156:0:8428:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787387920.351238:0:8428:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787387920.439266:0:8428:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787387920.439673:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787387920.439684:0:8428:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787387920.439702:0:8428:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26817551a44741c5 00000020:01000004:2.0:1787387920.439709:0:8428:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787387920.439732:0:8428:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787387920.439736:0:8428:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787387920.439742:0:8428:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787387920.439746:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787387920.439758:0:8428:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff996b73884d40) 00000020:00000080:2.0:1787387920.439779:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1787387920.449669:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387920.450068:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787387920.450075:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787387920.464483:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787387920.464502:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787387920.465677:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787387920.465686:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787387920.469146:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787387920.469311:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787387920.469316:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787387920.472162:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787387920.472176:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787387920.569681:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787387920.569930:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787387920.569936:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787387920.586584:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787387920.586681:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787387920.589397:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787387920.589410:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787387920.623997:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787387920.624208:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787387920.624216:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787387920.624625:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945596416:0@lo:400: 00000100:00100000:2.0:1787387920.624693:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387920.624743:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945596928:0@lo:400: 00000100:00100000:2.0:1787387920.624773:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387920.624800:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387920.624806:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945596544:0@lo:400: 00000100:00100000:2.0:1787387920.624829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387920.624869:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945596928 00000100:00100000:2.0:1787387920.624877:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945596928 00000100:00100000:2.0:1787387920.624920:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787387920.624928:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945596928:12345-0@lo:400: 00000100:00100000:2.0:1787387920.624997:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945596928:12345-0@lo:400: Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.625005:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787387920.625043:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945596544 00000100:00100000:2.0:1787387920.625047:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945596544 00000100:00100000:2.0:1787387920.625072:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387920.625078:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945596544:12345-0@lo:400: 00000100:00100000:2.0:1787387920.625108:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945596544:12345-0@lo:400: Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.625124:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787387920.625163:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b72b59500 x1874211945596544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387920.625176:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945596544:0@lo:400: 00000100:00100000:2.0:1787387920.625186:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945596928:0@lo:400: 00000100:00100000:3.0:1787387920.625705:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387920.625717:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945597056:0@lo:41: 00000100:00100000:3.0:1787387920.625747:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387920.627108:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945596672:0@lo:400: 00000100:00100000:1.0:1787387920.627158:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387920.627208:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387920.627216:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945596800:0@lo:400: 00000100:00100000:1.0:1787387920.627253:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387920.627301:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945597056 00000100:00100000:1.0:1787387920.627301:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945596416 00000100:00100000:3.0:1787387920.627309:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945597056 00000100:00100000:1.0:1787387920.627309:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945596416 00000100:00100000:3.0:1787387920.627375:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945596672 00000100:00100000:3.0:1787387920.627379:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945596672 00000100:00100000:1.0:1787387920.627449:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787387920.627461:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3651:x1874211945596416:12345-0@lo:400: 00000100:00100000:0.0:1787387920.627520:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787387920.627533:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945597056:12345-0@lo:41: 00000004:00000024:0.0:1787387920.627560:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787387920.627576:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3651:x1874211945596416:12345-0@lo:400: Request processed in 117us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387920.627589:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787387920.627608:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945597056:12345-0@lo:41: Request processed in 75us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387920.627616:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787387920.627632:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945596800 00000100:00100000:1.0:1787387920.627638:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945596800 00000100:00100000:0.0:1787387920.627642:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387920.627651:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945596672:12345-0@lo:400: 00000100:00100000:1.0:1787387920.627680:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787387920.627690:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945596800:12345-0@lo:400: 00000100:00100000:0.0:1787387920.627697:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945596672:12345-0@lo:400: Request processed in 45us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387920.627706:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787387920.627730:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945596800:12345-0@lo:400: Request processed in 42us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387920.627738:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787387920.627747:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b72b59180 x1874211945596800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387920.627762:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945596800:0@lo:400: 00000100:00100000:0.0:1787387920.627775:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945596672:0@lo:400: 00000100:00100000:0.0:1787387920.629058:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787387920.629069:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787387920.633138:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945596416:0@lo:400: 00000100:00100000:3.0:1787387920.633300:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945597056:0@lo:41: 00000100:00100000:2.0:1787387920.741405:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787387920.741599:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787387920.741606:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787387920.750939:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787387920.750953:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787387920.760405:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787387920.760438:0:8428:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787387920.760445:0:8428:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787387920.814832:0:8428:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787387920.815580:0:8428:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.115@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787387920.815585:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787387920.815587:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787387920.815588:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387920.815589:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387920.815591:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387920.815593:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387920.815594:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387920.815596:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387920.815597:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387920.815599:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387920.815600:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787387920.815604:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787387920.815606:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787387920.815607:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787387920.815608:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387920.815610:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387920.815611:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387920.815619:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387920.815621:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387920.815622:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387920.815623:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387920.815624:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387920.815625:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787387920.815650:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787387920.815669:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945597184:0@lo:253: 00000100:00100000:2.0:1787387920.815740:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387920.815825:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387920.817489:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945597184 00000100:00100000:0.0:1787387920.817501:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945597184 00000100:00100000:0.0:1787387920.817613:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787387920.817625:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:8428:x1874211945597184:12345-0@lo:253: 20000000:01000000:0.0:1787387920.817671:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787387920.817675:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787387920.817680:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787387920.817683:0:6516:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787387920.818615:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387920.818792:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787387920.818809:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787387920.818825:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787387920.818856:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787387920.818874:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787387920.818888:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787387920.818986:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787387920.819003:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1787387920.819005:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787387920.819019:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787387920.819253:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787387920.819273:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787387920.819281:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1787387920.819294:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787387920.819301:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787387920.819314:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787387920.819329:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787387920.819435:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1787387920.819447:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1787387920.819449:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787387920.819463:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1787387920.819469:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787387920.819480:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1787387920.819485:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1787387920.819495:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1787387920.819501:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787387920.819514:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1787387920.819547:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1787387920.822724:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1787387920.822752:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1787387920.822755:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787387920.824554:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1787387920.824579:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787387920.824610:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1787387920.824632:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1787387920.824649:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1787387920.824659:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787387920.824671:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1787387920.824688:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1787387920.824705:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787387920.824709:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787387920.824712:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787387920.824800:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787387920.824803:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787387920.825768:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1787387920.825816:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1787387920.825835:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787387920.826943:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787387920.827099:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787387920.827119:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787387920.827130:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787387920.827132:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787387920.827658:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1787387920.827681:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1787387920.827696:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787387920.828145:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1787387920.828166:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1787387920.828181:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1787387920.833132:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787387920.833139:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787387920.833868:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1787387920.833920:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1787387920.833936:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1787387920.834143:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1787387920.834186:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1787387920.834216:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1787387920.834226:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787387920.834228:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787387920.835276:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787387920.835508:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787387920.835530:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787387920.835554:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1787387920.835570:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787387920.835590:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.835616:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b40030c00/0x26817551a447409f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474098 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.835624:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b40031c00/0x26817551a4474116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447410f expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.835631:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b70077400/0x26817551a447414e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474147 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.835637:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b821d6000/0x26817551a447416a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474163 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.835643:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b413fee00/0x26817551a4474194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447418d expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.835651:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.835688:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b413fee00/0x26817551a4474194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a447418d expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.835701:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b413fee00/0x26817551a4474194 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a447418d expref: 18 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387920.835716:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b44948000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945597312:0@lo:104: 00000100:00100000:1.0:1787387920.835777:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387920.835831:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b821d6000/0x26817551a447416a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474163 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387920.835944:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945597312 00000100:00100000:3.0:1787387920.835952:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945597312 00000100:00100000:3.0:1787387920.836004:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787387920.836013:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6516:x1874211945597312:12345-0@lo:104: 00010000:00010000:3.0:1787387920.836036:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a447418d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.836089:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387920.836096:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6516:x1874211945597312:12345-0@lo:104: Request processed in 85us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.836103:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787387920.836256:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b821d6000/0x26817551a447416a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474163 expref: 18 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387920.836276:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945597440:0@lo:104: 00010000:00010000:1.0:1787387920.836288:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387920.836293:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a447418d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.836299:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787387920.836303:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a447418d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.836311:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a447418d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387920.836319:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a447418d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387920.836325:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387920.836440:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a447418d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.836447:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387920.836462:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a447418d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.836469:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a447418d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474194 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.836482:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387920.836483:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387920.836485:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387920.836497:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787387920.836507:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945597568:0@lo:103: 00000100:00100000:1.0:1787387920.836533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387920.836681:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387920.836703:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b70077400/0x26817551a447414e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474147 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.836711:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b70077400/0x26817551a447414e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474147 expref: 18 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387920.836719:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945597696:0@lo:104: 00000100:00100000:1.0:1787387920.836739:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387920.836755:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b40031c00/0x26817551a4474116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a447410f expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.836762:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b40031c00/0x26817551a4474116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a447410f expref: 18 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387920.836770:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945597824:0@lo:104: 00000100:00100000:1.0:1787387920.836787:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387920.836801:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b40030c00/0x26817551a447409f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474098 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.836809:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b40030c00/0x26817551a447409f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474098 expref: 18 pid: 6514 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387920.836816:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c55c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945597952:0@lo:104: 00000100:00100000:1.0:1787387920.836833:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387920.836944:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945597440 00000100:00100000:3.0:1787387920.836949:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945597440 00000100:00100000:3.0:1787387920.836978:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945597696 00000100:00100000:3.0:1787387920.836981:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945597696 00000100:00100000:3.0:1787387920.836991:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945597824 00000100:00100000:3.0:1787387920.836993:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945597824 00000100:00100000:3.0:1787387920.837000:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945597952 00000100:00100000:3.0:1787387920.837002:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945597952 00000100:00100000:3.0:1787387920.837044:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787387920.837050:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+6:6516:x1874211945597440:12345-0@lo:104: 00010000:00010000:3.0:1787387920.837058:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b40030000/0x26817551a4474163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837096:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387920.837102:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+6:6516:x1874211945597440:12345-0@lo:104: Request processed in 53us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.837108:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787387920.837122:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787387920.837127:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+5:6516:x1874211945597696:12345-0@lo:104: 00010000:00010000:3.0:1787387920.837134:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837163:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787387920.837169:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+5:6516:x1874211945597696:12345-0@lo:104: Request processed in 42us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.837174:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787387920.837185:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787387920.837202:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6516:x1874211945597824:12345-0@lo:104: 00010000:00010000:3.0:1787387920.837209:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a447410f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837231:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787387920.837235:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6516:x1874211945597824:12345-0@lo:104: Request processed in 36us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.837240:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787387920.837249:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787387920.837261:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6516:x1874211945597952:12345-0@lo:104: 00010000:00010000:3.0:1787387920.837268:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b70077000/0x26817551a4474098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837289:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787387920.837293:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6516:x1874211945597952:12345-0@lo:104: Request processed in 33us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.837298:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787387920.837313:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787387920.837317:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b40030000/0x26817551a4474163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837323:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030000 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787387920.837326:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b40030000/0x26817551a4474163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837332:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b40030000/0x26817551a4474163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387920.837337:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b40030000/0x26817551a4474163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387920.837342:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387920.837394:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b40030000/0x26817551a4474163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837399:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387920.837409:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b40030000/0x26817551a4474163 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837423:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b40030000/0x26817551a4474163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447416a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837434:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787387920.837437:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837442:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b413fe400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787387920.837444:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837450:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387920.837456:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387920.837460:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387920.837471:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837476:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387920.837488:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474147 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837494:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447414e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837502:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787387920.837511:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a447410f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837516:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b821d6800 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787387920.837519:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a447410f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837524:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a447410f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387920.837529:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a447410f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387920.837534:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387920.837556:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a447410f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837561:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387920.837566:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a447410f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837571:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a447410f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474116 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837579:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387920.837582:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70077000/0x26817551a4474098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837587:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077000 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787387920.837589:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70077000/0x26817551a4474098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837605:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70077000/0x26817551a4474098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387920.837611:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70077000/0x26817551a4474098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387920.837616:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387920.837627:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b70077000/0x26817551a4474098 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837632:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387920.837636:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70077000/0x26817551a4474098 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837642:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70077000/0x26817551a4474098 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447409f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.837653:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387920.837655:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387920.837656:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387920.837662:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387920.837671:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945598080:0@lo:103: 00000100:00100000:3.0:1787387920.837695:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387920.837712:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787387920.837717:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945598464:0@lo:103: 00000100:00100000:3.0:1787387920.837732:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387920.837749:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945598208:0@lo:103: 00000100:00100000:3.0:1787387920.837765:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387920.838276:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eee240 going to sleep for 11 seconds 00000100:00100000:1.0:1787387920.838304:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b44948000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945597312:0@lo:104: 00000100:00100000:1.0:1787387920.838322:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945597440:0@lo:104: 00000100:00100000:1.0:1787387920.838328:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945597696:0@lo:104: 00000100:00100000:1.0:1787387920.838335:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945597824:0@lo:104: 00000100:00100000:1.0:1787387920.838341:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c55c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874211945597952:0@lo:104: 00000100:00100000:3.0:1787387920.838472:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387920.838478:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945598336:0@lo:103: 00000100:00100000:3.0:1787387920.838507:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387920.838681:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387920.838921:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945597568 00000100:00100000:0.0:1787387920.838927:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945597568 00010000:00010000:0.0:1787387920.838950:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b413fee00/0x26817551a4474194 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447418d expref: 19 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387920.839092:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945598080 00000100:00100000:0.0:1787387920.839097:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945598080 00010000:00010000:0.0:1787387920.839111:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b821d6000/0x26817551a447416a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474163 expref: 20 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387920.839122:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945598464 00000100:00100000:0.0:1787387920.839124:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945598464 00010000:00010000:0.0:1787387920.839133:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b40030c00/0x26817551a447409f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474098 expref: 21 pid: 6514 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387920.839142:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945598208 00000100:00100000:0.0:1787387920.839145:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945598208 00010000:00010000:0.0:1787387920.839154:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b70077400/0x26817551a447414e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474147 expref: 22 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387920.839164:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945598336 00000100:00100000:0.0:1787387920.839167:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945598336 00010000:00010000:0.0:1787387920.839175:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b40031c00/0x26817551a4474116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447410f expref: 23 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387920.839196:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787387920.839205:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3650:x1874211945597568:12345-0@lo:103: 00010000:00010000:0.0:1787387920.839216:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387920.839228:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b413fee00/0x26817551a4474194 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447418d expref: 23 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.839238:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b413fee00/0x26817551a4474194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a447418d expref: 23 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.839253:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b413fee00/0x26817551a4474194 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a447418d expref: 23 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.839265:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387920.839309:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:3650:x1874211945597568:12345-0@lo:103: Request processed in 105us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387920.839316:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787387920.839331:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787387920.839337:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3650:x1874211945598080:12345-0@lo:103: 00000100:00100000:2.0:1787387920.839412:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387920.839422:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3650:x1874211945598464:12345-0@lo:103: 00010000:00010000:2.0:1787387920.839429:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387920.839434:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b40030c00/0x26817551a447409f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474098 expref: 21 pid: 6514 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.839443:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b40030c00/0x26817551a447409f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474098 expref: 21 pid: 6514 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.839453:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40030c00/0x26817551a447409f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474098 expref: 21 pid: 6514 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.839463:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387920.839488:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:3650:x1874211945598464:12345-0@lo:103: Request processed in 69us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.839504:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387920.839516:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387920.839522:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+19:3651:x1874211945598208:12345-0@lo:103: 00010000:00010000:2.0:1787387920.839529:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387920.839533:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b70077400/0x26817551a447414e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474147 expref: 19 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.839643:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b70077400/0x26817551a447414e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474147 expref: 19 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.839656:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70077400/0x26817551a447414e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474147 expref: 19 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.839664:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387920.839695:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3651:x1874211945598208:12345-0@lo:103: Request processed in 173us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.839701:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787387920.839712:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387920.839717:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:3651:x1874211945598336:12345-0@lo:103: 00010000:00010000:2.0:1787387920.839723:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387920.839726:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b40031c00/0x26817551a4474116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447410f expref: 17 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.839733:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b40031c00/0x26817551a4474116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a447410f expref: 17 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.839741:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40031c00/0x26817551a4474116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a447410f expref: 17 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.839760:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387920.839951:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387920.839957:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b821d6000/0x26817551a447416a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474163 expref: 16 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387920.840094:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:3651:x1874211945598336:12345-0@lo:103: Request processed in 377us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.840101:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787387920.840221:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945598336:0@lo:103: 00000100:00100000:1.0:1787387920.840230:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945598208:0@lo:103: 00010000:00010000:0.0:1787387920.840268:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b821d6000/0x26817551a447416a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474163 expref: 15 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.840278:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b821d6000/0x26817551a447416a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474163 expref: 15 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.840288:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.840296:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.840320:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.840326:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.840332:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.840338:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.840343:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076400 already unused, calling callback (ffffffffc0ce4e90) 00000100:00100000:3.0:1787387920.840473:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945598464:0@lo:103: 00000100:00100000:3.0:1787387920.840482:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945597568:0@lo:103: 00010000:00010000:0.0:1787387920.843057:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.843071:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.843096:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.843113:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387920.843248:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+14:3650:x1874211945598080:12345-0@lo:103: Request processed in 3907us (5547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387920.843257:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787387920.843552:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.843562:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.843568:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70076400/0x26817551a44741d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787387920.843585:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787387920.848725:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+13:8428:x1874211945597184:12345-0@lo:253: Request processed in 31094us (32975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387920.848739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787387920.848881:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945597184:0@lo:253: 10000000:01000000:2.0:1787387920.848896:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787387920.848899:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787387920.848901:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787387920.848902:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387920.848903:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787387920.848904:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387920.848906:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387920.848907:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387920.848909:0:8428:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787387920.848910:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387920.848912:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787387920.848931:0:8428:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996b74ea1800 from lustre-OST0000 10000000:01000000:2.0:1787387920.848961:0:8428:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787387920.848974:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787387920.848982:0:8428:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff996b72b819c0 local copy 10000000:01000000:2.0:1787387920.848985:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787387920.849017:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.849028:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.849037:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387920.849054:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945598592:0@lo:101: 00000100:00100000:2.0:1787387920.849101:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387920.849136:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce900 going to sleep for 11 seconds 00000100:00100000:1.0:1787387920.849299:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945598592 00000100:00100000:1.0:1787387920.849307:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945598592 00000100:00100000:1.0:1787387920.849378:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787387920.849388:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+13:8428:x1874211945598592:12345-0@lo:101: 00010000:00010000:1.0:1787387920.849402:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387920.849422:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70076e00/0x26817551a44741e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44741da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.849444:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70076e00/0x26817551a44741e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44741da expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.849454:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70076e00/0x26817551a44741e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44741da expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.849462:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076e00, rc 0) 00000100:00100000:1.0:1787387920.849499:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945598592:12345-0@lo:101: Request processed in 113us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387920.849504:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787387920.849687:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945598592:0@lo:101: 00010000:00010000:0.0:1787387920.849699:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.849718:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387920.849811:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945598720:0@lo:501: 00000100:00100000:0.0:1787387920.849848:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387920.849868:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7bde90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387920.850651:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945598720 00000100:00100000:1.0:1787387920.850658:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945598720 00000100:00100000:1.0:1787387920.850693:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787387920.850700:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945598720:12345-0@lo:501: 00000100:00100000:1.0:1787387920.850771:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945598720:12345-0@lo:501: Request processed in 70us (931us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787387920.850777:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787387920.851017:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945598720:0@lo:501: 10000000:01000000:0.0:1787387920.851032:0:8428:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787387920.851052:0:8428:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787387920.851057:0:8428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.851067:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.851075:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.851098:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787387920.851123:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996b74ea1800 10000000:01000000:0.0:1787387920.851128:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787387920.851133:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787387920.851135:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787387920.851139:0:8428:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787387920.851142:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787387920.851162:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.851183:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.851200:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387920.851216:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945598848:0@lo:101: 00000100:00100000:0.0:1787387920.851245:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387920.851274:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7bde9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387920.851395:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945598848 00000100:00100000:1.0:1787387920.851400:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945598848 00000100:00100000:1.0:1787387920.851426:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787387920.851432:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945598848:12345-0@lo:101: 00010000:00010000:1.0:1787387920.851440:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387920.851449:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70077c00/0x26817551a44741ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44741e8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.851465:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077c00/0x26817551a44741ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44741e8 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.851482:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70077c00/0x26817551a44741ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44741e8 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.851489:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077c00, rc 0) 00000100:00100000:1.0:1787387920.851518:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945598848:12345-0@lo:101: Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387920.851524:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:2.0:1787387920.851676:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387920.851682:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.851689:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b413ffe00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787387920.851692:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.851700:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387920.851707:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387920.851711:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387920.851728:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.851734:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387920.851752:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.851759:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44741da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26817551a44741e1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.851771:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387920.851773:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387920.851775:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387920.851837:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945598848:0@lo:101: 00000100:00100000:1.0:1787387920.852041:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387920.852053:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945598976:0@lo:103: 00000100:00100000:1.0:1787387920.852084:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387920.852153:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945598976 00000100:00100000:2.0:1787387920.852164:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945598976 00000100:00100000:2.0:1787387920.852209:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787387920.852216:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3649:x1874211945598976:12345-0@lo:103: 00010000:00010000:2.0:1787387920.852225:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387920.852236:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70076e00/0x26817551a44741e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a44741da expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387920.852246:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387920.852275:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:3649:x1874211945598976:12345-0@lo:103: Request processed in 60us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.852281:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787387920.852326:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.852334:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387920.852482:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945598976:0@lo:103: 00000100:00100000:0.0:1787387920.852728:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599104:0@lo:501: 00000100:00100000:0.0:1787387920.852757:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387920.852787:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7bde9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387920.852924:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945599104 00000100:00100000:1.0:1787387920.852929:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945599104 00000100:00100000:1.0:1787387920.852959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787387920.853304:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945599104:12345-0@lo:501: 00000100:00100000:1.0:1787387920.853442:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945599104:12345-0@lo:501: Request processed in 476us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387920.853450:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787387920.853558:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945598080:0@lo:103: 00000100:00100000:0.0:1787387920.853859:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599104:0@lo:501: 00000100:00100000:0.0:1787387920.853903:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599232:0@lo:503: 00000100:00100000:0.0:1787387920.853939:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387920.853972:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7bde9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387920.854451:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945599232 00000100:00100000:2.0:1787387920.854457:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945599232 00000100:00100000:2.0:1787387920.854490:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787387920.854497:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945599232:12345-0@lo:503: 00000100:00100000:2.0:1787387920.854610:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945599232:12345-0@lo:503: Request processed in 112us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.854618:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787387920.854860:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599232:0@lo:503: 00000040:00080000:1.0:1787387920.855254:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787387920.855316:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599360:0@lo:502: 00000100:00100000:1.0:1787387920.855484:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387920.855564:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387920.857660:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945599360 00000100:00100000:3.0:1787387920.857673:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945599360 00000100:00100000:3.0:1787387920.857735:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787387920.857745:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945599360:12345-0@lo:502: 00000100:00100000:3.0:1787387920.857897:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945599360:12345-0@lo:502: Request processed in 152us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.857904:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787387920.858067:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599360:0@lo:502: 00000040:00080000:1.0:1787387920.858311:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787387920.858389:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787387920.858408:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787387920.858421:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787387920.858432:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787387920.858445:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787387920.858476:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599488:0@lo:502: 00000100:00100000:1.0:1787387920.858517:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387920.858542:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387920.858696:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945599488 00000100:00100000:3.0:1787387920.858701:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945599488 00000100:00100000:3.0:1787387920.858731:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787387920.858737:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945599488:12345-0@lo:502: 00000100:00100000:3.0:1787387920.858800:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945599488:12345-0@lo:502: Request processed in 62us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.858805:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787387920.859059:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599488:0@lo:502: 00000040:00080000:1.0:1787387920.859095:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787387920.859103:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787387920.859687:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787387920.859695:0:8451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787387920.859702:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387920.859704:0:8451:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787387920.859709:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387920.859722:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff996b7bdf99c0) 00000020:00000080:1.0:1787387920.859742:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787387920.859747:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787387920.859811:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b74ea1800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787387920.859818:0:8451:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787387920.859824:0:8451:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26817551a44741fd 00010000:00010000:1.0:1787387920.865286:0:8451:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1787387920.866288:0:8451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787387920.870226:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787387920.870719:0:8451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787387920.887076:0:8451:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787387920.889231:0:8451:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1787387920.923546:0:8451:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787387920.939216:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787387920.939227:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387920.939239:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387920.939242:0:8451:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787387920.939246:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387920.939249:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387920.939251:0:8451:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787387920.939253:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787387920.939255:0:8451:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787387920.939283:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387920.939287:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387920.939288:0:8451:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787387920.939291:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787387920.939695:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787387920.939727:0:8428:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787387920.939791:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.939802:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387920.939817:0:8428:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b74ea1800 from 1 10000000:01000000:3.0:1787387920.939820:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787387920.939864:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.939872:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.939881:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387920.939903:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599616:0@lo:101: 00000100:00100000:3.0:1787387920.939978:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387920.940024:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47d71840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387920.940046:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945599616 00000100:00100000:3.0:1787387920.940054:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945599616 00000100:00100000:3.0:1787387920.940093:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787387920.940100:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945599616:12345-0@lo:101: 00010000:00010000:3.0:1787387920.940112:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387920.940124:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b821d7c00/0x26817551a447420b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474204 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.940144:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b821d7c00/0x26817551a447420b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474204 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.940156:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b821d7c00/0x26817551a447420b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474204 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.940164:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b821d7c00, rc 0) 00000100:00100000:3.0:1787387920.940218:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945599616:12345-0@lo:101: Request processed in 117us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.940224:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787387920.940269:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599616:0@lo:101: 00010000:00010000:3.0:1787387920.940284:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387920.940292:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387920.940618:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599744:0@lo:501: 00000100:00100000:3.0:1787387920.940645:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387920.940658:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47d71840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387920.940676:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945599744 00000100:00100000:3.0:1787387920.940680:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945599744 00000100:00100000:3.0:1787387920.940703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787387920.940709:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945599744:12345-0@lo:501: 00000100:00100000:3.0:1787387920.942086:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945599744:12345-0@lo:501: Request processed in 1371us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.942096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787387920.942164:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599744:0@lo:501: 00000100:00100000:3.0:1787387920.942209:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599872:0@lo:503: 00000100:00100000:3.0:1787387920.942251:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387920.942279:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47d71840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387920.942295:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945599872 00000100:00100000:3.0:1787387920.942300:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945599872 00000100:00100000:3.0:1787387920.942325:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787387920.942337:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945599872:12345-0@lo:503: 00000100:00100000:3.0:1787387920.944079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945599872:12345-0@lo:503: Request processed in 1734us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.944089:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787387920.944157:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945599872:0@lo:503: 00000040:00080000:3.0:1787387920.944456:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787387920.944537:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600000:0@lo:502: 00000100:00100000:3.0:1787387920.944579:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387920.944607:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517e8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387920.944625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945600000 00000100:00100000:3.0:1787387920.944629:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945600000 00000100:00100000:3.0:1787387920.944659:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787387920.944666:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945600000:12345-0@lo:502: 00000100:00100000:3.0:1787387920.947502:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945600000:12345-0@lo:502: Request processed in 2825us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.947519:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787387920.948015:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600000:0@lo:502: 00000040:00080000:0.0:1787387920.973569:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787387920.973636:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787387920.973686:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600128:0@lo:502: 00000100:00100000:0.0:1787387920.973762:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387920.973805:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7bde9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387920.974283:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945600128 00000100:00100000:3.0:1787387920.974292:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945600128 00000100:00100000:3.0:1787387920.974471:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787387920.974482:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945600128:12345-0@lo:502: 00000100:00100000:3.0:1787387920.974652:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945600128:12345-0@lo:502: Request processed in 172us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387920.974660:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787387920.975082:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600128:0@lo:502: 00000040:00080000:1.0:1787387920.975156:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787387920.975165:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787387920.976279:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387920.976291:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387920.976293:0:8455:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787387920.976300:0:8455:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b74ea1800 00000020:00000080:2.0:1787387920.976303:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787387920.976313:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387920.976316:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387920.976318:0:8455:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787387920.976320:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787387920.976569:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787387920.976594:0:8428:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787387920.976615:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.976626:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387920.976674:0:8428:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787387920.976677:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996b74ea1800 10000000:01000000:1.0:1787387920.976680:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996b74ea1800 10000000:01000000:1.0:1787387920.976683:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787387920.976690:0:8428:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b74ea1800 from 1 10000000:01000000:1.0:1787387920.976693:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387920.976724:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.977054:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.977066:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387920.977087:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600256:0@lo:101: 00000100:00100000:1.0:1787387920.977141:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387920.977185:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f060c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387920.977251:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945600256 00000100:00100000:0.0:1787387920.977258:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945600256 00000100:00100000:0.0:1787387920.977303:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787387920.977311:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8428:x1874211945600256:12345-0@lo:101: 00010000:00010000:0.0:1787387920.977323:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387920.977335:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09a00/0x26817551a4474219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474212 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.977390:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09a00/0x26817551a4474219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474212 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.977402:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09a00/0x26817551a4474219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474212 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387920.977410:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09a00, rc 0) 00000100:00100000:0.0:1787387920.977458:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:8428:x1874211945600256:12345-0@lo:101: Request processed in 147us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387920.977466:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787387920.977711:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600256:0@lo:101: 00010000:00010000:1.0:1787387920.977724:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387920.977812:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387920.977943:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600384:0@lo:501: 00000100:00100000:1.0:1787387920.978036:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387920.978062:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f060c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387920.978104:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945600384 00000100:00100000:2.0:1787387920.978109:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945600384 00000100:00100000:2.0:1787387920.978147:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787387920.978155:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:8428:x1874211945600384:12345-0@lo:501: 00000100:00100000:2.0:1787387920.978269:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:8428:x1874211945600384:12345-0@lo:501: Request processed in 114us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.978276:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787387920.978488:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600384:0@lo:501: 00000100:00100000:1.0:1787387920.978511:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600512:0@lo:503: 00000100:00100000:1.0:1787387920.978557:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387920.978579:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f060c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387920.978648:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945600512 00000100:00100000:2.0:1787387920.978653:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945600512 00000100:00100000:2.0:1787387920.978682:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787387920.978687:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:8428:x1874211945600512:12345-0@lo:503: 00000100:00100000:2.0:1787387920.978922:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:8428:x1874211945600512:12345-0@lo:503: Request processed in 234us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.978930:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787387920.979069:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600512:0@lo:503: 00000040:00080000:1.0:1787387920.979298:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787387920.979624:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600640:0@lo:502: 00000100:00100000:1.0:1787387920.979660:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387920.979688:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f060c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387920.979952:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945600640 00000100:00100000:0.0:1787387920.979957:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945600640 00000100:00100000:0.0:1787387920.980142:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787387920.980151:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:8428:x1874211945600640:12345-0@lo:502: 00000100:00100000:0.0:1787387920.980261:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:8428:x1874211945600640:12345-0@lo:502: Request processed in 112us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387920.980269:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787387920.980332:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600640:0@lo:502: 00000040:00080000:1.0:1787387920.981110:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787387920.981140:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787387920.981153:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787387920.981165:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787387920.981178:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787387920.981204:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787387920.981218:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787387920.981231:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787387920.981243:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787387920.981255:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787387920.981278:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787387920.981290:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787387920.981302:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787387920.981313:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787387920.981337:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787387920.981531:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787387920.981602:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787387920.981619:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787387920.981631:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787387920.981643:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787387920.981656:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787387920.981669:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787387920.981682:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787387920.981695:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787387920.981707:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787387920.981720:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787387920.981923:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787387920.981948:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787387920.982030:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787387920.982052:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787387920.982081:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787387920.982096:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787387920.982109:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787387920.982122:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787387920.982135:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787387920.982148:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787387920.982161:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1787387920.982205:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600768:0@lo:502: 00000100:00100000:1.0:1787387920.982262:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387920.982502:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945600768 00000100:00100000:0.0:1787387920.982508:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945600768 00000100:00100000:1.0:1787387920.982599:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f060c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387920.982664:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787387920.982675:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:8428:x1874211945600768:12345-0@lo:502: 00000100:00100000:2.0:1787387920.983052:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:8428:x1874211945600768:12345-0@lo:502: Request processed in 378us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.983061:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787387920.983153:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945600768:0@lo:502: 00000040:00080000:1.0:1787387920.983223:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787387920.983232:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787387920.984301:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787387920.984315:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff996b738819c0) 00000020:00000080:2.0:1787387920.984337:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787387920.985284:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b74ea1800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787387920.985290:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b74ea1800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787387920.985293:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b74ea1800 3 00010000:00080000:2.0:1787387920.985324:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a41f5a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1787387920.993435:0:8456:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1787387920.993535:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787387920.993590:0:8456:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787387920.993609:0:8456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x26817551a4474227 00000100:00080000:2.0:1787387920.993620:0:8456:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387920.993626:0:8456:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff996a41f5a800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787387920.993659:0:8456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b72b59500 x1874211945600896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387920.993679:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787387920.994195:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1874211945600896:0@lo:38: 00000100:00100000:3.0:1787387920.994265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387920.994673:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945600896 00000100:00100000:2.0:1787387920.994681:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945600896 00000100:00100000:2.0:1787387920.994717:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387920.994724:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874211945600896:12345-0@lo:38: 00010000:00080000:2.0:1787387920.994863:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:2.0:1787387920.994891:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x26817551a447422e 00000004:00100000:2.0:1787387920.994904:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787387920.994930:0:6521:0:(import.c:65:import_set_state_nolock()) ffff996a41f5a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387920.995098:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874211945600896:12345-0@lo:38: Request processed in 373us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387920.995106:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1787387920.995208:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787387920.995233:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff996a420c0000) 00000020:00000080:2.0:1787387920.995249:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787387920.995483:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b74ea1800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787387920.995488:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b74ea1800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787387920.995491:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b74ea1800 3 00010000:00080000:2.0:1787387920.995529:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a420ca000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.115@tcp at head 00010000:00080000:3.0:1787387920.997127:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b72b59500 x1874211945600896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387920.997148:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787387920.997158:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787387920.997167:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787387920.997172:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787387920.997175:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a41f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787387920.997182:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1874211945600896:0@lo:38: 00010000:00010000:2.0:1787387921.005301:0:8456:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00010000:00010000:3.0:1787387921.005502:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787387921.006490:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787387921.006533:0:8456:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787387921.006544:0:8456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x26817551a447423c 00000100:00080000:2.0:1787387921.006560:0:8456:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787387921.006566:0:8456:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff996a420ca000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787387921.006599:0:8456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b72b59880 x1874211945601024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787387921.006625:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787387921.007054:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1874211945601024:0@lo:38: 00000100:00100000:3.0:1787387921.007119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.007869:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945601024 00000100:00100000:1.0:1787387921.007878:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945601024 00000100:00100000:1.0:1787387921.007912:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387921.007921:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874211945601024:12345-0@lo:38: 00010000:00080000:1.0:1787387921.007947:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:1.0:1787387921.008100:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x26817551a4474243 00000004:00100000:1.0:1787387921.008115:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787387921.008147:0:6522:0:(import.c:65:import_set_state_nolock()) ffff996a41c5d000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1787387921.008519:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787387921.009869:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874211945601024:12345-0@lo:38: Request processed in 1943us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.009880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:1.0:1787387921.009910:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787387921.009942:0:8428:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387921.010057:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.010070:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787387921.010121:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787387921.010123:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387921.010124:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387921.010126:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387921.010127:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387921.010128:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387921.010130:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387921.010131:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387921.010132:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387921.010134:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387921.010140:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787387921.010144:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787387921.010146:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787387921.010147:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787387921.010148:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787387921.010149:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787387921.010150:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787387921.010152:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787387921.010153:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787387921.010154:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787387921.010155:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787387921.010156:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787387921.010157:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787387921.010180:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787387921.010214:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945601152:0@lo:253: 00000100:00100000:1.0:1787387921.010266:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.010300:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06cc0 going to sleep for 11 seconds 00010000:00080000:1.0:1787387921.010500:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b72b59880 x1874211945601024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387921.010510:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787387921.010518:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787387921.010525:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787387921.010529:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787387921.010533:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a420ca000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787387921.010540:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1874211945601024:0@lo:38: 00000100:00100000:0.0:1787387921.010655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945601152 00000100:00100000:0.0:1787387921.010661:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945601152 00000100:00100000:0.0:1787387921.010702:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787387921.010711:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:8428:x1874211945601152:12345-0@lo:253: 20000000:01000000:0.0:1787387921.010808:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787387921.010823:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787387921.020767:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787387921.020790:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787387921.021081:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787387921.021086:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787387921.021110:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.021128:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b40030200/0x26817551a4474140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474139 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.021152:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b821d6a00/0x26817551a447415c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474155 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.021160:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.021204:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b821d6a00/0x26817551a447415c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474155 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.021218:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b821d6a00/0x26817551a447415c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474155 expref: 16 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387921.021233:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945601280:0@lo:104: 00000100:00100000:1.0:1787387921.021300:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387921.021380:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b40030200/0x26817551a4474140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474139 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.021389:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b40030200/0x26817551a4474140 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474139 expref: 16 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387921.021396:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945601408:0@lo:104: 00000100:00100000:1.0:1787387921.021416:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06180 going to sleep for 11 seconds 00000100:00100000:3.0:1787387921.021528:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787387921.021548:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.021569:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945601280 00000100:00100000:3.0:1787387921.021576:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945601280 00000100:00100000:3.0:1787387921.021607:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945601408 00000100:00100000:3.0:1787387921.021610:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945601408 00000100:00100000:3.0:1787387921.021625:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787387921.021633:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74142c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6536:x1874211945601280:12345-0@lo:104: 00010000:00010000:3.0:1787387921.021644:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b40030400/0x26817551a4474155 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.021705:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387921.021712:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74142c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6536:x1874211945601280:12345-0@lo:104: Request processed in 79us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.021719:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787387921.021755:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787387921.021762:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6536:x1874211945601408:12345-0@lo:104: 00010000:00010000:3.0:1787387921.021778:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.021812:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787387921.021817:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6536:x1874211945601408:12345-0@lo:104: Request processed in 57us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.021823:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787387921.021851:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787387921.021857:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b40030400/0x26817551a4474155 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.021864:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787387921.021868:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b40030400/0x26817551a4474155 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.021876:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b40030400/0x26817551a4474155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387921.021885:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b40030400/0x26817551a4474155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387921.021890:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387921.021918:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b40030400/0x26817551a4474155 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.021924:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387921.021942:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b40030400/0x26817551a4474155 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.021949:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b40030400/0x26817551a4474155 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447415c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.021980:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387921.021985:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.021991:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b821d6c00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787387921.021994:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022002:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387921.022009:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387921.022014:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387921.022028:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022036:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387921.022041:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474139 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022047:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474139 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474140 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022061:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387921.022063:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387921.022064:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387921.022071:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387921.022098:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945601536:0@lo:103: 00000100:00100000:3.0:1787387921.022124:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.022145:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387921.022151:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945601664:0@lo:103: 00000100:00100000:3.0:1787387921.022170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.022207:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945601536 00000100:00100000:3.0:1787387921.022211:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945601536 00010000:00010000:3.0:1787387921.022227:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b821d6a00/0x26817551a447415c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474155 expref: 17 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.022246:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945601664 00000100:00100000:3.0:1787387921.022249:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945601664 00010000:00010000:3.0:1787387921.022259:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b40030200/0x26817551a4474140 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474139 expref: 18 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.022276:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787387921.022282:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3651:x1874211945601536:12345-0@lo:103: 00010000:00010000:3.0:1787387921.022292:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387921.022296:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b821d6a00/0x26817551a447415c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474155 expref: 18 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022306:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b821d6a00/0x26817551a447415c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474155 expref: 18 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022320:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387921.022492:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3651:x1874211945601536:12345-0@lo:103: Request processed in 63us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.022499:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787387921.022512:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787387921.022519:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:3651:x1874211945601664:12345-0@lo:103: 00010000:00010000:3.0:1787387921.022532:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387921.022537:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b40030200/0x26817551a4474140 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474139 expref: 17 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022546:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b40030200/0x26817551a4474140 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474139 expref: 17 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022558:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022565:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787387921.022576:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007665635s 00010000:00010000:3.0:1787387921.022580:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022587:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022594:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022600:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022605:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076200 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787387921.022609:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022615:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022631:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.022641:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387921.022665:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:3651:x1874211945601664:12345-0@lo:103: Request processed in 146us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.022672:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787387921.022708:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945601664:0@lo:103: 00000100:00100000:3.0:1787387921.022716:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945601536:0@lo:103: 00010000:00010000:1.0:1787387921.023599:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b821d6a00/0x26817551a447415c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474155 expref: 16 pid: 6516 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387921.023612:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945601280:0@lo:104: 00010000:00010000:1.0:1787387921.023622:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40030200/0x26817551a4474140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474139 expref: 15 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387921.023645:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945601408:0@lo:104: 00010000:00010000:1.0:1787387921.023660:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.023668:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.023674:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.023680:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70076200/0x26817551a447424a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.023899:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+14:8428:x1874211945601152:12345-0@lo:253: Request processed in 13188us (13631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.023910:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787387921.024587:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:8428:1874211945601152:0@lo:253: 10000000:01000000:2.0:1787387921.024599:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787387921.024602:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787387921.024604:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787387921.024605:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387921.024606:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387921.024608:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387921.024609:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387921.024611:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387921.024613:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387921.024614:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387921.024616:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387921.024617:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787387921.024628:0:8428:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787387921.031237:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787387921.031817:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787387921.032236:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787387921.037159:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787387921.038244:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787387921.039711:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1787387921.044099:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787387921.059070:0:8428:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787387921.059082:0:8428:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787387921.059122:0:8428:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787387921.059168:0:8428:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787387921.059200:0:8428:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787387921.059228:0:8428:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787387921.060721:0:8428:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787387921.061103:0:8428:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 10000000:01000000:3.0:1787387921.582432:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787387921.582440:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b73aa7800 from 30 10000000:01000000:3.0:1787387921.582445:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787387921.582491:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.582502:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.582511:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.582534:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945601792:0@lo:101: 00000100:00100000:3.0:1787387921.582608:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.582658:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4607ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.582741:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945601792 00000100:00100000:2.0:1787387921.582748:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945601792 00000100:00100000:2.0:1787387921.582800:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787387921.582809:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+14:6518:x1874211945601792:12345-0@lo:101: 00010000:00010000:2.0:1787387921.582827:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387921.582849:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b413ff800/0x26817551a4474258 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474251 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.582869:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b413ff800/0x26817551a4474258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474251 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.582879:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b413ff800/0x26817551a4474258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474251 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.582887:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b413ff800, rc 0) 00000100:00100000:2.0:1787387921.582925:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945601792:12345-0@lo:101: Request processed in 117us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.582931:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787387921.582975:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945601792:0@lo:101: 00010000:00010000:2.0:1787387921.582989:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.582998:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387921.583070:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945601920:0@lo:501: 00000100:00100000:2.0:1787387921.583094:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387921.583114:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.583127:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945601920 00000100:00100000:2.0:1787387921.583130:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945601920 00000100:00100000:2.0:1787387921.583152:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787387921.583157:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945601920:12345-0@lo:501: 00000100:00100000:2.0:1787387921.583287:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945601920:12345-0@lo:501: Request processed in 129us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.583295:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787387921.583324:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945601920:0@lo:501: 00000100:00100000:2.0:1787387921.583377:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602048:0@lo:503: 00000100:00100000:2.0:1787387921.583415:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387921.583428:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.583439:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945602048 00000100:00100000:2.0:1787387921.583443:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945602048 00000100:00100000:2.0:1787387921.583461:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787387921.583467:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945602048:12345-0@lo:503: 00000100:00100000:2.0:1787387921.583537:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945602048:12345-0@lo:503: Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.583544:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787387921.583582:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602048:0@lo:503: 00000100:00100000:0.0:1787387921.583874:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8479:1874211945602176:0@lo:502: 00000100:00100000:0.0:1787387921.583909:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387921.583936:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b580723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.583993:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945602176 00000100:00100000:2.0:1787387921.584095:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945602176 00000100:00100000:2.0:1787387921.584127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787387921.584134:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8479:x1874211945602176:12345-0@lo:502: 00000100:00100000:2.0:1787387921.586192:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8479:x1874211945602176:12345-0@lo:502: Request processed in 2042us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.586207:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787387921.588234:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8479:1874211945602176:0@lo:502: 00000100:00100000:3.0:1787387921.588308:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8479:1874211945602304:0@lo:502: 00000100:00100000:3.0:1787387921.588398:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.588434:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4607e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.589857:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945602304 00000100:00100000:2.0:1787387921.589867:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945602304 00000100:00100000:2.0:1787387921.589924:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787387921.589934:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8479:x1874211945602304:12345-0@lo:502: 00000100:00100000:2.0:1787387921.590295:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:8479:x1874211945602304:12345-0@lo:502: Request processed in 361us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.590303:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787387921.590434:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8479:1874211945602304:0@lo:502: 00000040:00080000:3.0:1787387921.590462:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787387921.590676:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787387921.590695:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387921.590704:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.590715:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387921.590724:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787387921.590727:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b73aa7800 from 5 10000000:01000000:2.0:1787387921.590730:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787387921.590758:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.590767:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.590776:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387921.590792:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602432:0@lo:101: 00000100:00100000:2.0:1787387921.590823:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387921.591037:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387921.594744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945602432 00000100:00100000:3.0:1787387921.594760:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945602432 00000100:00100000:3.0:1787387921.594817:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787387921.594827:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945602432:12345-0@lo:101: 00010000:00010000:3.0:1787387921.594856:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387921.594877:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b821d7600/0x26817551a4474266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447425f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.594906:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b821d7600/0x26817551a4474266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447425f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.594918:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b821d7600/0x26817551a4474266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447425f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.594927:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b821d7600, rc 0) 00000100:00100000:0.0:1787387921.595122:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602432:0@lo:101: 00010000:00010000:0.0:1787387921.595140:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.595150:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387921.595235:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602560:0@lo:256: 00000100:00100000:0.0:1787387921.595276:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387921.595304:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387921.595449:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945602432:12345-0@lo:101: Request processed in 623us (4625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.595457:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787387921.595483:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945602560 00000100:00100000:3.0:1787387921.595487:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945602560 00000100:00100000:3.0:1787387921.595502:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787387921.595507:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945602560:12345-0@lo:256: 20000000:01000000:3.0:1787387921.595527:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787387921.595543:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787387921.595546:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787387921.595776:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945602560:12345-0@lo:256: Request processed in 268us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.595783:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787387921.604177:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602560:0@lo:256: 10000000:01000000:1.0:1787387921.604330:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787387921.604342:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.604392:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387921.604402:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787387921.604405:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1787387921.604418:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787387921.604453:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.604462:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.604472:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387921.604490:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602688:0@lo:101: 00000100:00100000:1.0:1787387921.604552:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.604607:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.604725:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945602688 00000100:00100000:2.0:1787387921.604732:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945602688 00000100:00100000:2.0:1787387921.604786:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787387921.604796:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945602688:12345-0@lo:101: 00010000:00010000:2.0:1787387921.604815:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387921.604827:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b413ffe00/0x26817551a4474274 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447426d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.604850:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b413ffe00/0x26817551a4474274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447426d expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.604861:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b413ffe00/0x26817551a4474274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447426d expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.604872:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b413ffe00, rc 0) 00000100:00100000:2.0:1787387921.604910:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945602688:12345-0@lo:101: Request processed in 115us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.604917:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787387921.605247:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602688:0@lo:101: 00010000:00010000:1.0:1787387921.605260:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387921.605270:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387921.605323:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602816:0@lo:501: 00000100:00100000:1.0:1787387921.605378:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.605400:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.605449:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945602816 00000100:00100000:2.0:1787387921.605454:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945602816 00000100:00100000:2.0:1787387921.605483:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787387921.605491:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945602816:12345-0@lo:501: 00000100:00100000:2.0:1787387921.605620:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945602816:12345-0@lo:501: Request processed in 128us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.605627:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787387921.606091:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602816:0@lo:501: 00000100:00100000:1.0:1787387921.606119:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602944:0@lo:503: 00000100:00100000:1.0:1787387921.606164:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.606203:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.606247:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945602944 00000100:00100000:2.0:1787387921.606251:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945602944 00000100:00100000:2.0:1787387921.606284:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787387921.606292:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945602944:12345-0@lo:503: 00000100:00100000:2.0:1787387921.606401:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945602944:12345-0@lo:503: Request processed in 109us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.606407:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787387921.606496:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945602944:0@lo:503: 00000100:00100000:0.0:1787387921.607015:0:8481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8481:1874211945603072:0@lo:502: 00000100:00100000:0.0:1787387921.607054:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387921.607084:0:8481:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2480 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.608311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945603072 00000100:00100000:2.0:1787387921.608321:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945603072 00000100:00100000:2.0:1787387921.608387:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787387921.608396:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:8481:x1874211945603072:12345-0@lo:502: 00000100:00100000:2.0:1787387921.608530:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:8481:x1874211945603072:12345-0@lo:502: Request processed in 135us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.608539:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787387921.608744:0:8481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8481:1874211945603072:0@lo:502: 00000020:01000000:0.0:1787387921.608780:0:8481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787387921.608789:0:8481:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787387921.608796:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387921.608799:0:8481:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787387921.608805:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787387921.608809:0:8481:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:0.0:1787387921.608830:0:8481:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787387921.608833:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787387921.608847:0:8481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff996b72b83380) 00000020:00000080:0.0:1787387921.608870:0:8481:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1787387921.608875:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787387921.608950:0:8481:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787387921.608956:0:8481:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787387921.608962:0:8481:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a4474282 00010000:00080000:0.0:1787387921.608988:0:8481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996b74f91800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1787387921.609210:0:8481:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787387921.630503:0:8481:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787387921.630530:0:8481:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787387921.631561:0:8481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387921.631887:0:8481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387921.632046:0:8481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787387921.632146:0:8481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787387921.634565:0:8482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787387921.634573:0:8482:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787387921.636910:0:8481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787387921.636924:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787387921.636973:0:8481:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787387921.636996:0:8481:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a4474289 00000100:00080000:3.0:1787387921.637016:0:8481:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787387921.637028:0:8481:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff996b74f91800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787387921.637063:0:8481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b738e9f80 x1874211945603200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787387921.637088:0:8481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1787387921.637213:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945603456:0@lo:400: 00000100:00100000:3.0:1787387921.637271:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.637301:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945603968:0@lo:400: 00000100:00100000:3.0:1787387921.637323:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.637339:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787387921.637366:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945603328:0@lo:400: 00000100:00100000:3.0:1787387921.637387:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.637406:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945603840:0@lo:400: 00000100:00100000:3.0:1787387921.637424:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.637453:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945603584:0@lo:400: 00000100:00100000:3.0:1787387921.637474:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.637485:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387921.637490:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945603712:0@lo:400: 00000100:00100000:3.0:1787387921.637507:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.637546:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945603456 00000100:00100000:3.0:1787387921.637552:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945603456 00000100:00100000:3.0:1787387921.637581:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945603712 00000100:00100000:3.0:1787387921.637584:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945603712 00000100:00100000:3.0:1787387921.637599:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787387921.637606:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945603456:12345-0@lo:400: 00000100:00100000:3.0:1787387921.637655:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945603456:12345-0@lo:400: Request processed in 48us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.637662:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787387921.637678:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387921.637684:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945603712:12345-0@lo:400: 00000100:00100000:3.0:1787387921.637711:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945603712:12345-0@lo:400: Request processed in 27us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.637717:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387921.637748:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945603712:0@lo:400: 00000100:00100000:3.0:1787387921.637773:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945603456:0@lo:400: 00000020:01000000:3.0:1787387921.637829:0:8481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387921.637834:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387921.637836:0:8481:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787387921.637840:0:8481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387921.637845:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387921.637846:0:8481:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787387921.637850:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787387921.637856:0:8481:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787387921.637878:0:8481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8481:1874211945604096:0@lo:502: 00000100:00100000:3.0:1787387921.637919:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.637943:0:8481:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4503ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387921.638169:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945603200:0@lo:8: 00000100:00100000:1.0:1787387921.638216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.638256:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945603968 00000100:00100000:1.0:1787387921.638260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945603968 00000100:00100000:1.0:1787387921.638290:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945603328 00000100:00100000:1.0:1787387921.638293:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945603328 00000100:00100000:1.0:1787387921.638303:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945603840 00000100:00100000:1.0:1787387921.638306:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945603840 00000100:00100000:1.0:1787387921.638318:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945603584 00000100:00100000:1.0:1787387921.638320:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945603584 00000100:00100000:1.0:1787387921.638333:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787387921.638339:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945603968:12345-0@lo:400: 00000100:00100000:1.0:1787387921.638407:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945603968:12345-0@lo:400: Request processed in 67us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.638414:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787387921.638428:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787387921.638433:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945603328:12345-0@lo:400: 00000100:00100000:1.0:1787387921.638458:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945603328:12345-0@lo:400: Request processed in 25us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.638464:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787387921.638474:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787387921.638479:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945603840:12345-0@lo:400: 00000100:00100000:1.0:1787387921.638512:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945603840:12345-0@lo:400: Request processed in 33us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.638519:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787387921.638530:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787387921.638535:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945603584:12345-0@lo:400: 00000100:00100000:1.0:1787387921.638562:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945603584:12345-0@lo:400: Request processed in 27us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.638568:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787387921.638596:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c8a80 x1874211945603584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387921.638609:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945603584:0@lo:400: 00010000:00080000:1.0:1787387921.638629:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b738e9880 x1874211945603328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387921.638639:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945603328:0@lo:400: 00010000:00080000:1.0:1787387921.638652:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0cad80 x1874211945603840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387921.638661:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945603840:0@lo:400: 00010000:00080000:1.0:1787387921.638670:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c9c00 x1874211945603968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387921.638678:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945603968:0@lo:400: 00000100:00100000:3.0:1787387921.638889:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945603200 00000100:00100000:3.0:1787387921.638894:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945603200 00000100:00100000:3.0:1787387921.638922:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787387921.638928:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1874211945603200:12345-0@lo:8: 00010000:00080000:3.0:1787387921.638949:0:8434:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:3.0:1787387921.638972:0:8434:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a4474290 00002000:00100000:3.0:1787387921.639177:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff996b44935800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787387921.639192:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1787387921.639196:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787387921.639261:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787387921.639482:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787387921.639505:0:8434:0:(import.c:65:import_set_state_nolock()) ffff996b44930000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787387921.639562:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1874211945603200:12345-0@lo:8: Request processed in 632us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.639570:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787387921.641225:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945604096 00000100:00100000:0.0:1787387921.641236:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945604096 00000100:00100000:0.0:1787387921.641295:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787387921.641303:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:8481:x1874211945604096:12345-0@lo:502: 00000100:00100000:0.0:1787387921.641462:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:8481:x1874211945604096:12345-0@lo:502: Request processed in 159us (3541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.641469:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787387921.641523:0:8481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8481:1874211945604096:0@lo:502: 00000020:01000000:0.0:1787387921.641554:0:8481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387921.641561:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387921.641563:0:8481:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787387921.641568:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00010000:00080000:0.0:1787387921.644814:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b738e9f80 x1874211945603200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387921.644829:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387921.644839:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787387921.644849:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787387921.644855:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787387921.644858:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b74f91800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787387921.644882:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787387921.644889:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945603200:0@lo:8: 00000004:00080000:3.0:1787387921.645318:0:8482:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787387921.645422:0:8482:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 243168073834ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787387921.645428:0:8482:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787387921.645490:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0caa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1874211945604224:0@lo:700: 00000100:00100000:3.0:1787387921.645549:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.645591:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4503e9c0 going to sleep for 11 seconds 00000020:01000000:0.0:1787387921.646437:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1787387921.646469:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787387921.646479:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.646490:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387921.646500:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787387921.646510:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b46a34000 from 30 10000000:01000000:0.0:1787387921.646513:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787387921.646539:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.646546:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.646556:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387921.646570:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945604352:0@lo:101: 00000100:00100000:0.0:1787387921.646675:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.646791:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945604224 00000100:00100000:1.0:1787387921.646798:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945604224 00000100:00100000:1.0:1787387921.646843:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387921.646853:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8483:x1874211945604224:12345-0@lo:700: 00000100:00100000:1.0:1787387921.646892:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1874211945604480:0@lo:700: 00000100:00100000:1.0:1787387921.646920:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.646939:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06000 going to sleep for 11 seconds 00000100:00100000:1.0:1787387921.646963:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945604480 00000100:00100000:1.0:1787387921.646967:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945604480 00000100:00100000:1.0:1787387921.646997:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387921.647011:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1874211945604480:12345-0@lo:700: 00000100:00100000:0.0:1787387921.647102:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2b40 going to sleep for 11 seconds 00000004:00080000:0.0:1787387921.653759:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787387921.653891:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945604352 00000100:00100000:3.0:1787387921.653902:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945604352 00000100:00100000:3.0:1787387921.654156:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787387921.654173:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945604352:12345-0@lo:101: 00010000:00010000:3.0:1787387921.654200:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387921.654218:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b821d7e00/0x26817551a447429e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474297 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.654246:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b821d7e00/0x26817551a447429e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474297 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.654258:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b821d7e00/0x26817551a447429e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474297 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.654267:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b821d7e00, rc 0) 00000100:00100000:3.0:1787387921.654361:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945604352:12345-0@lo:101: Request processed in 172us (7668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.654369:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787387921.654500:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945604352:0@lo:101: 00010000:00010000:0.0:1787387921.654517:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.654526:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387921.654606:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945604608:0@lo:501: 00000100:00100000:0.0:1787387921.654639:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387921.654908:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387921.656921:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945604608 00000100:00100000:1.0:1787387921.656935:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945604608 00000100:00100000:1.0:1787387921.656985:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787387921.656994:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945604608:12345-0@lo:501: 00000100:00100000:1.0:1787387921.657204:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945604608:12345-0@lo:501: Request processed in 210us (2563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.657212:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787387921.657267:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945604608:0@lo:501: 00000100:00100000:1.0:1787387921.657314:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945604736:0@lo:503: 00000100:00100000:1.0:1787387921.657380:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.657405:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f063c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387921.657417:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945604736 00000100:00100000:1.0:1787387921.657421:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945604736 00000100:00100000:1.0:1787387921.657437:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787387921.657443:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945604736:12345-0@lo:503: 00000100:00100000:1.0:1787387921.657514:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945604736:12345-0@lo:503: Request processed in 69us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.657521:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787387921.657556:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945604736:0@lo:503: 00000100:00100000:3.0:1787387921.660011:0:8484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8484:1874211945604864:0@lo:502: 00000100:00100000:3.0:1787387921.660079:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.660372:0:8484:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4503e0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787387921.661503:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387921.661511:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387921.661514:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787387921.661638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945604864 00000100:00100000:0.0:1787387921.661649:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945604864 00000100:00100000:0.0:1787387921.661750:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787387921.661760:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:8484:x1874211945604864:12345-0@lo:502: 00000100:00100000:0.0:1787387921.661946:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:8484:x1874211945604864:12345-0@lo:502: Request processed in 187us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.661954:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787387921.662199:0:8484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8484:1874211945604864:0@lo:502: 00000100:00100000:3.0:1787387921.662260:0:8484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8484:1874211945604992:0@lo:502: 00000100:00100000:3.0:1787387921.662295:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.662327:0:8484:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42bf9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387921.662655:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945604992 00000100:00100000:0.0:1787387921.662659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945604992 00000100:00100000:0.0:1787387921.662697:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787387921.662705:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:8484:x1874211945604992:12345-0@lo:502: 00000100:00100000:0.0:1787387921.662773:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:8484:x1874211945604992:12345-0@lo:502: Request processed in 68us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.662779:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787387921.662852:0:8484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8484:1874211945604992:0@lo:502: 00000040:00080000:3.0:1787387921.662884:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787387921.663487:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787387921.663515:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787387921.663526:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.663538:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387921.663548:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787387921.663551:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b46a34000 from 5 10000000:01000000:0.0:1787387921.663554:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787387921.665160:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.665175:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.665197:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387921.665239:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945605120:0@lo:101: 00000100:00100000:0.0:1787387921.665295:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387921.665339:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2e40 going to sleep for 11 seconds 40000000:02000000:1.0:1787387921.665730:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1787387921.666093:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945605120 00000100:00100000:3.0:1787387921.666102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945605120 00000100:00100000:3.0:1787387921.666151:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787387921.666160:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945605120:12345-0@lo:101: 00010000:00010000:3.0:1787387921.666174:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387921.666203:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b821d6a00/0x26817551a44742ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44742a5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.666228:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b821d6a00/0x26817551a44742ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44742a5 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.666238:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b821d6a00/0x26817551a44742ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44742a5 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.666246:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b821d6a00, rc 0) 00000100:00100000:3.0:1787387921.666293:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945605120:12345-0@lo:101: Request processed in 135us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.666300:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787387921.666358:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945605120:0@lo:101: 00010000:00010000:3.0:1787387921.666373:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.666382:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.666443:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945605248:0@lo:256: 00000100:00100000:3.0:1787387921.666475:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.666495:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42bf9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387921.666506:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945605248 00000100:00100000:3.0:1787387921.666515:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945605248 00000100:00100000:3.0:1787387921.666533:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787387921.666539:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945605248:12345-0@lo:256: 20000000:01000000:3.0:1787387921.666552:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787387921.666566:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787387921.666569:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787387921.666652:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945605248:12345-0@lo:256: Request processed in 112us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.666659:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787387921.666689:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945605248:0@lo:256: 10000000:01000000:3.0:1787387921.667631:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787387921.667641:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.667652:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387921.667662:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787387921.667665:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787387921.667667:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787387921.667689:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.667805:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.667815:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387921.667831:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945605376:0@lo:101: 00000100:00100000:3.0:1787387921.668051:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.668072:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4915c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387921.668093:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945605376 00000100:00100000:3.0:1787387921.668097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945605376 00000100:00100000:3.0:1787387921.668120:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787387921.668127:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945605376:12345-0@lo:101: 00010000:00010000:3.0:1787387921.668137:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387921.668147:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b821d6e00/0x26817551a44742ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44742b3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.668164:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b821d6e00/0x26817551a44742ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44742b3 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.668173:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b821d6e00/0x26817551a44742ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44742b3 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387921.668668:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b821d6e00, rc 0) 00000100:00100000:3.0:1787387921.668779:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945605376:12345-0@lo:101: Request processed in 651us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.668787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787387921.668812:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945605376:0@lo:101: 00010000:00010000:0.0:1787387921.668829:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.668840:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387921.668898:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945605504:0@lo:501: 00000100:00100000:0.0:1787387921.668930:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387921.668973:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387921.669410:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945605504 00000100:00100000:0.0:1787387921.669416:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945605504 00000100:00100000:0.0:1787387921.669447:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787387921.669454:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945605504:12345-0@lo:501: 00000100:00100000:2.0:1787387921.670565:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945605504:0@lo:501: 00000100:00100000:2.0:1787387921.670688:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945605632:0@lo:503: 00000100:00100000:2.0:1787387921.670749:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387921.670782:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387921.671889:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945605504:12345-0@lo:501: Request processed in 127us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.671902:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787387921.671952:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945605632 00000100:00100000:0.0:1787387921.672662:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945605632 00000100:00100000:0.0:1787387921.672713:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787387921.672722:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945605632:12345-0@lo:503: 00000100:00100000:0.0:1787387921.672870:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945605632:12345-0@lo:503: Request processed in 149us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.672886:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787387921.674847:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945605632:0@lo:503: 00000100:00100000:2.0:1787387921.678768:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8485:1874211945605760:0@lo:502: 00000100:00100000:2.0:1787387921.678851:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387921.678956:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea900 going to sleep for 11 seconds 00000100:00100000:0.0:1787387921.679691:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945605760 00000100:00100000:0.0:1787387921.679698:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945605760 00000100:00100000:0.0:1787387921.679747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787387921.679756:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+20:8485:x1874211945605760:12345-0@lo:502: 00000100:00100000:0.0:1787387921.679893:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+20:8485:x1874211945605760:12345-0@lo:502: Request processed in 137us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.679901:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787387921.680709:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8485:1874211945605760:0@lo:502: 00000020:01000000:2.0:1787387921.680745:0:8485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787387921.680752:0:8485:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787387921.680759:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387921.680762:0:8485:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787387921.680766:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787387921.680770:0:8485:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:2.0:1787387921.680792:0:8485:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787387921.680794:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387921.680809:0:8485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff996a420c4d40) 00000020:00000080:2.0:1787387921.680830:0:8485:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1787387921.680843:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787387921.680949:0:8485:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787387921.680954:0:8485:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787387921.681200:0:8485:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a44742c8 00010000:00080000:2.0:1787387921.681230:0:8485:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a41f58800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1787387921.681485:0:8485:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1787387921.686252:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1874211945604480:12345-0@lo:700: Request processed in 39241us (39323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.686265:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787387921.686724:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996a41c56300 x1874211945604480/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787387937 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387921.686742:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1874211945604480:0@lo:700: 40000000:02000000:0.0:1787387921.686756:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:2.0:1787387921.695408:0:8485:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787387921.695433:0:8485:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787387921.695714:0:8485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387921.695912:0:8485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387921.695994:0:8485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787387921.696082:0:8485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787387921.696665:0:8487:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787387921.696670:0:8487:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787387921.697377:0:8485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787387921.697388:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787387921.697421:0:8485:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787387921.697440:0:8485:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a44742cf 00000100:00080000:1.0:1787387921.697449:0:8485:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787387921.697454:0:8485:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff996a41f58800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1787387921.697483:0:8485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996a41c57100 x1874211945605888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787387921.697503:0:8485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787387921.697550:0:8485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387921.697553:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387921.697555:0:8485:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787387921.697557:0:8485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387921.697561:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387921.697562:0:8485:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787387921.697565:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787387921.697567:0:8485:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787387921.697717:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945605888:0@lo:8: 00000100:00100000:2.0:1787387921.697781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.697910:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8485:1874211945606016:0@lo:502: 00000100:00100000:1.0:1787387921.697951:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.698002:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387921.699071:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945606016 00000100:00100000:2.0:1787387921.699078:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945606016 00000100:00100000:0.0:1787387921.699242:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945605888 00000100:00100000:0.0:1787387921.699248:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945605888 00000100:00100000:0.0:1787387921.699275:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387921.699294:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1874211945605888:12345-0@lo:8: 00010000:00080000:0.0:1787387921.699322:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:0.0:1787387921.699363:0:8437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a44742d6 00002000:00100000:0.0:1787387921.699379:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff996b74f92800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1787387921.699380:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00002000:00080000:0.0:1787387921.699387:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787387921.699390:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787387921.699392:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+20:8485:x1874211945606016:12345-0@lo:502: 00002000:00080000:0.0:1787387921.699452:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787387921.699478:0:8437:0:(import.c:65:import_set_state_nolock()) ffff996b74f96000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387921.699521:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+20:8485:x1874211945606016:12345-0@lo:502: Request processed in 131us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.699529:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787387921.699539:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1874211945605888:12345-0@lo:8: Request processed in 255us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.699558:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787387921.699608:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996a41c57100 x1874211945605888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387921.699617:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787387921.699624:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787387921.699631:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787387921.699636:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787387921.699638:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a41f58800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787387921.699651:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787387921.699656:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945605888:0@lo:8: 00000004:00080000:2.0:1787387921.700741:0:8487:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787387921.700793:0:8487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 243223445683ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787387921.700800:0:8487:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787387921.703210:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787387921.703471:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:8485:1874211945606016:0@lo:502: 00000020:01000000:1.0:1787387921.703513:0:8485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387921.703521:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387921.703524:0:8485:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787387921.703536:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000001:00100000:0.0:1787387921.703707:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787387921.703720:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787387921.703747:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787387921.703757:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.703776:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387921.703787:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787387921.703790:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff996b72b819c0 from 1 10000000:01000000:2.0:1787387921.703793:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1787387921.703823:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8483:x1874211945604224:12345-0@lo:700: Request processed in 56970us (58272us total) trans 0 rc 0/0 00010000:00010000:2.0:1787387921.703828:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.703838:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387921.703839:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787387921.703852:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787387921.703953:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0caa00 x1874211945604224/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787387937 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387921.703966:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0caa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1874211945604224:0@lo:700: 00000100:00100000:2.0:1787387921.704464:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945606144:0@lo:101: 00000100:00100000:2.0:1787387921.704508:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387921.704540:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787387921.705322:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945606144 00000100:00100000:0.0:1787387921.705329:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945606144 00000100:00100000:0.0:1787387921.705384:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787387921.705392:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945606144:12345-0@lo:101: 00010000:00010000:0.0:1787387921.705405:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387921.705418:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e08800/0x26817551a44742e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44742dd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.705443:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e08800/0x26817551a44742e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44742dd expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.705454:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e08800/0x26817551a44742e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44742dd expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.705474:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08800, rc 0) 00000100:00100000:0.0:1787387921.705532:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945606144:12345-0@lo:101: Request processed in 140us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.705540:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787387921.705724:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945606144:0@lo:101: 00010000:00010000:2.0:1787387921.705739:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387921.705747:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387921.705819:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945606272:0@lo:501: 00000100:00100000:2.0:1787387921.705848:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387921.706503:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945606272 00000100:00100000:0.0:1787387921.706510:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945606272 00000100:00100000:0.0:1787387921.706554:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787387921.706562:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945606272:12345-0@lo:501: 00000100:00100000:0.0:1787387921.706647:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945606272:12345-0@lo:501: Request processed in 85us (797us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787387921.706654:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787387921.706687:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787387921.706700:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945606272:0@lo:501: 10000000:01000000:0.0:1787387921.706729:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787387921.706736:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387921.706746:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787387921.710889:0:8488:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787387921.710920:0:8488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1874211945606528:0@lo:7: 00000100:00100000:2.0:1787387921.710983:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387921.711010:0:8488:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387921.711120:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945606400:0@lo:13: 00000100:00100000:3.0:1787387921.711155:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387921.711394:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945606400 00000100:00100000:2.0:1787387921.711402:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945606400 00000100:00100000:2.0:1787387921.711456:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787387921.711465:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874211945606400:12345-0@lo:13: 00002000:00000024:2.0:1787387921.711484:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:2.0:1787387921.711526:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874211945606400:12345-0@lo:13: Request processed in 61us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387921.711532:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787387921.711639:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787387921.711670:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b72b58700 x1874211945606400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387921.711708:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945606400:0@lo:13: 00000100:00100000:0.0:1787387921.713333:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945606528 00000100:00100000:0.0:1787387921.713343:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945606528 00000100:00100000:0.0:1787387921.713400:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387921.713407:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8488:x1874211945606528:12345-0@lo:7: 00000004:00080000:3.0:1787387921.715739:0:8483:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787387921.715773:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1874211945606784:0@lo:7: 00000100:00100000:3.0:1787387921.715843:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.715979:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4915c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387921.715994:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387921.716005:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945606656:0@lo:13: 00000100:00100000:3.0:1787387921.716029:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.716058:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945606656 00000100:00100000:3.0:1787387921.716063:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945606656 00000100:00100000:3.0:1787387921.716094:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787387921.716101:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945606656:12345-0@lo:13: 00002000:00000024:3.0:1787387921.716122:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1787387921.716164:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945606656:12345-0@lo:13: Request processed in 63us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387921.716171:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787387921.716220:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c8e00 x1874211945606656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387921.716238:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945606656:0@lo:13: 00000100:00100000:2.0:1787387921.716548:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787387921.716712:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787387921.716936:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945606784 00000100:00100000:3.0:1787387921.716941:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945606784 00000100:00100000:2.0:1787387921.717091:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787387921.717100:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8483:x1874211945606784:12345-0@lo:7: 00002000:00080000:0.0:1787387921.720672:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787387921.720680:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787387921.720780:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8488:x1874211945606528:12345-0@lo:7: Request processed in 7368us (9792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.720791:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787387921.720965:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b72b58e00 x1874211945606528/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787387937 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387921.720979:0:8488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1874211945606528:0@lo:7: 00000004:00080000:3.0:1787387921.721000:0:8488:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787387921.721038:0:8488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1874211945606912:0@lo:5: 00000100:00100000:3.0:1787387921.721074:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.721106:0:8488:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4503e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387921.722435:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945606912 00000100:00100000:0.0:1787387921.722444:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945606912 00000100:00100000:0.0:1787387921.722496:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787387921.722505:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8488:x1874211945606912:12345-0@lo:5: 00002000:00080000:0.0:1787387921.722540:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787387921.722544:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:1.0:1787387921.728554:0:8490:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787387921.728561:0:8490:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787387921.728687:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8483:x1874211945606784:12345-0@lo:7: Request processed in 11585us (12840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.728701:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787387921.728771:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c9500 x1874211945606784/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787387937 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387921.728785:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1874211945606784:0@lo:7: 00000004:00080000:3.0:1787387921.728799:0:8483:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787387921.728829:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1874211945607040:0@lo:5: 00000100:00100000:3.0:1787387921.729084:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.729112:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4503ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387921.729557:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945607040 00000100:00100000:0.0:1787387921.729564:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945607040 00000100:00100000:0.0:1787387921.729726:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787387921.729736:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8483:x1874211945607040:12345-0@lo:5: 00002000:00080000:0.0:1787387921.729774:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1787387921.729825:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8483:x1874211945607040:12345-0@lo:5: Request processed in 91us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.729832:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787387921.729896:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c9500 x1874211945607040/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387937 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387921.729907:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1874211945607040:0@lo:5: 00000004:00080000:2.0:1787387921.729916:0:8483:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787387921.729941:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1874211945607168:0@lo:5: 00000100:00100000:2.0:1787387921.729967:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387921.730248:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea540 going to sleep for 11 seconds 00000100:00100000:1.0:1787387921.730286:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945607168 00000100:00100000:1.0:1787387921.730292:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945607168 00000100:00100000:1.0:1787387921.730315:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787387921.730321:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8483:x1874211945607168:12345-0@lo:5: 00002000:00080000:1.0:1787387921.730376:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787387921.733412:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8483:x1874211945607168:12345-0@lo:5: Request processed in 3083us (3437us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787387921.733422:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:2.0:1787387921.733905:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787387921.733918:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1787387921.734121:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b72b58e00 x1874211945607168/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387937 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387921.734155:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1874211945607168:0@lo:5: 00000004:00080000:2.0:1787387921.734170:0:8483:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1787387921.734313:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8483:1874211945607296:0@lo:900: 00000100:00100000:3.0:1787387921.734372:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.734397:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42bf9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387921.734451:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945607296 00000100:00100000:1.0:1787387921.734457:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945607296 00000100:00100000:1.0:1787387921.734497:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387921.734507:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8483:x1874211945607296:12345-0@lo:900: 00000100:00100000:1.0:1787387921.734561:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8483:x1874211945607296:12345-0@lo:900: Request processed in 56us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387921.734569:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787387921.734685:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0ca680 x1874211945607296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787387937 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387921.734694:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8483:1874211945607296:0@lo:900: 00000100:00100000:0.0:1787387921.735297:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8488:x1874211945606912:12345-0@lo:5: Request processed in 12791us (14220us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787387921.735305:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787387921.735381:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c8e00 x1874211945606912/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387937 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387921.735390:0:8488:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787387921.735394:0:8488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1874211945606912:0@lo:5: 00000004:00080000:3.0:1787387921.735405:0:8488:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787387921.735549:0:8488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1874211945607424:0@lo:700: 00000100:00100000:3.0:1787387921.735578:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387921.735634:0:8488:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42bf9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387921.735673:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945607424 00000100:00100000:0.0:1787387921.735677:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945607424 00000100:00100000:0.0:1787387921.735710:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787387921.735716:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8488:x1874211945607424:12345-0@lo:700: 00000001:00080000:3.0:1787387921.749544:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1787387921.749760:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8488:x1874211945607424:12345-0@lo:700: Request processed in 14039us (14177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387921.749773:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787387921.749882:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c8e00 x1874211945607424/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787387937 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387921.749897:0:8488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1874211945607424:0@lo:700: 00000004:02000040:2.0:1787387921.751231:0:8488:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1787387921.765740:0:8488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1874211945607552:0@lo:5: 00000100:00100000:3.0:1787387921.765809:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387921.765897:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945607552 00000100:00100000:1.0:1787387921.765905:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945607552 00000100:00100000:1.0:1787387921.765968:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387921.765976:0:8488:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42bf9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387921.765979:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8488:x1874211945607552:12345-0@lo:5: 00002000:00080000:1.0:1787387921.776636:0:8490:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787387921.776655:0:8490:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1787387921.780422:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8488:x1874211945607552:12345-0@lo:5: Request processed in 14438us (14605us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787387921.780437:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787387921.783517:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c8e00 x1874211945607552/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387937 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387921.783537:0:8488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1874211945607552:0@lo:5: 00000004:00080000:3.0:1787387921.783552:0:8488:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1787387922.028506:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787387922.393967:0:8521:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787387922.394235:0:8521:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787387923.053791:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387923.692531:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945607680:0@lo:41: 00000100:00100000:3.0:1787387923.692598:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387923.692780:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945607680 00000100:00100000:0.0:1787387923.692788:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945607680 00000100:00100000:0.0:1787387923.694247:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787387923.694263:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945607680:12345-0@lo:41: 00000004:00000024:0.0:1787387923.694301:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787387923.694382:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945607680:12345-0@lo:41: Request processed in 124us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387923.694391:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787387923.694508:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945607680:0@lo:41: 00010000:00010000:3.0:1787387924.079455:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387925.102474:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387925.741319:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387925.741364:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945607808:0@lo:41: 00000100:00100000:3.0:1787387925.741439:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387925.742443:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945607808 00000100:00100000:2.0:1787387925.742459:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945607808 00000100:00100000:2.0:1787387925.742531:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787387925.742544:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945607808:12345-0@lo:41: 00000004:00000024:2.0:1787387925.742605:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787387925.747039:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945607808:12345-0@lo:41: Request processed in 4481us (5583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387925.747059:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787387925.747085:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945607808:0@lo:41: 00010000:00010000:3.0:1787387926.135284:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387926.765522:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945607936:0@lo:400: 00000100:00100000:1.0:1787387926.765605:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.765648:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945608448:0@lo:400: 00000100:00100000:1.0:1787387926.765673:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.765834:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945608960:0@lo:400: 00000100:00100000:1.0:1787387926.765863:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.765887:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787387926.765894:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945608064:0@lo:400: 00000100:00100000:1.0:1787387926.765915:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.765931:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945608576:0@lo:400: 00000100:00100000:1.0:1787387926.765950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.765973:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945608192:0@lo:400: 00000100:00100000:1.0:1787387926.765994:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.766011:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945608704:0@lo:400: 00000100:00100000:1.0:1787387926.766031:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.766047:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787387926.766052:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945608320:0@lo:400: 00000100:00100000:1.0:1787387926.766072:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.766082:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945608832:0@lo:400: 00000100:00100000:1.0:1787387926.766101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.766133:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945608448 00000100:00100000:1.0:1787387926.766141:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945608448 00000100:00100000:1.0:1787387926.766189:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945608192 00000100:00100000:1.0:1787387926.766192:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945608192 00000100:00100000:1.0:1787387926.766210:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787387926.766219:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945608448:12345-0@lo:400: 00000100:00100000:1.0:1787387926.766807:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945608448:12345-0@lo:400: Request processed in 588us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387926.766816:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787387926.766903:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387926.766910:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945608192:12345-0@lo:400: 00000100:00100000:1.0:1787387926.766946:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945608192:12345-0@lo:400: Request processed in 37us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387926.766953:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387926.766976:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945608960 00000100:00100000:1.0:1787387926.766980:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945608960 00000100:00100000:1.0:1787387926.767014:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945608832 00000100:00100000:1.0:1787387926.767017:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945608832 00000100:00100000:1.0:1787387926.767036:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387926.767043:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1874211945608960:12345-0@lo:400: 00000100:00100000:1.0:1787387926.767074:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1874211945608960:12345-0@lo:400: Request processed in 32us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387926.767081:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787387926.767091:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387926.767097:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945608832:12345-0@lo:400: 00000100:00100000:1.0:1787387926.767121:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945608832:12345-0@lo:400: Request processed in 25us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387926.767127:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787387926.767143:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945608064 00000100:00100000:1.0:1787387926.767157:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945608064 00000100:00100000:1.0:1787387926.767176:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945608576 00000100:00100000:1.0:1787387926.767178:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945608576 00000100:00100000:1.0:1787387926.767189:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945608704 00000100:00100000:1.0:1787387926.767191:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945608704 00000100:00100000:1.0:1787387926.767212:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945608320 00000100:00100000:1.0:1787387926.767215:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945608320 00000100:00100000:0.0:1787387926.767398:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945607936 00000100:00100000:0.0:1787387926.767402:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945607936 00000100:00100000:0.0:1787387926.767430:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787387926.767436:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3651:x1874211945607936:12345-0@lo:400: 00000100:00100000:0.0:1787387926.767472:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3651:x1874211945607936:12345-0@lo:400: Request processed in 36us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387926.767478:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787387926.769208:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787387926.769305:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945608064:12345-0@lo:400: 00000100:00100000:1.0:1787387926.769405:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945608064:12345-0@lo:400: Request processed in 183us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387926.769412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787387926.769440:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787387926.769447:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945608576:12345-0@lo:400: 00000100:00100000:1.0:1787387926.769494:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945608576:12345-0@lo:400: Request processed in 46us (3541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387926.769500:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787387926.769513:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787387926.769520:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945608704:12345-0@lo:400: 00000100:00100000:1.0:1787387926.769548:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945608704:12345-0@lo:400: Request processed in 30us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387926.769554:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787387926.769565:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787387926.769571:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945608320:12345-0@lo:400: 00010000:00080000:0.0:1787387926.769919:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996a41c54380 x1874211945608064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387926.769935:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945608064:0@lo:400: 00010000:00080000:0.0:1787387926.769947:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996a41c55880 x1874211945608576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387926.769955:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945608576:0@lo:400: 00000100:00100000:0.0:1787387926.769965:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945607936:0@lo:400: 00000100:00100000:0.0:1787387926.769980:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945608448:0@lo:400: 00010000:00080000:0.0:1787387926.769991:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996a41c56680 x1874211945608960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387926.770014:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945608960:0@lo:400: 00000100:00100000:0.0:1787387926.770039:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387926.770049:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945609088:0@lo:13: 00000100:00100000:0.0:1787387926.770084:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.770918:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945608320:12345-0@lo:400: Request processed in 1343us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387926.770928:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787387926.770957:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787387926.770962:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787387926.770965:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787387926.770996:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996a41c54000 x1874211945608320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387926.771022:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945608320:0@lo:400: 00010000:00080000:1.0:1787387926.771037:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996a41c56300 x1874211945608832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387926.771044:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787387926.771056:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945608832:0@lo:400: 00000100:00100000:1.0:1787387926.771067:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945608192:0@lo:400: 00010000:00080000:1.0:1787387926.771080:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996a41c57100 x1874211945608704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387926.771088:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945608704:0@lo:400: 00000100:00100000:0.0:1787387926.771422:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945609088 00000100:00100000:0.0:1787387926.771432:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945609088 00000100:00100000:0.0:1787387926.771475:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387926.771483:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874211945609088:12345-0@lo:13: 00002000:00000024:0.0:1787387926.771508:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387926.771550:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874211945609088:12345-0@lo:13: Request processed in 68us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387926.771556:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787387926.771915:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387926.771928:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945609216:0@lo:13: 00000100:00100000:2.0:1787387926.771963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387926.772367:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945609216 00000100:00100000:1.0:1787387926.772373:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945609216 00000100:00100000:1.0:1787387926.772393:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387926.772400:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945609216:12345-0@lo:13: 00002000:00000024:1.0:1787387926.772412:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387926.772449:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945609216:12345-0@lo:13: Request processed in 49us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387926.772454:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787387926.772482:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b72b58000 x1874211945609216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387926.772497:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945609216:0@lo:13: 00010000:00080000:1.0:1787387926.772521:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7389ce00 x1874211945609088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387926.772534:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945609088:0@lo:13: 00010000:00010000:1.0:1787387927.155008:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787387927.282021:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1787387928.173009:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787387928.547171:0:8811:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787387928.822084:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387928.822112:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945609344:0@lo:41: 00000100:00100000:1.0:1787387928.822193:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387928.822264:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945609344 00000100:00100000:1.0:1787387928.822272:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945609344 00000100:00100000:1.0:1787387928.822805:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787387928.822816:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945609344:12345-0@lo:41: 00000004:00000024:1.0:1787387928.822853:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787387928.822952:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945609344:12345-0@lo:41: Request processed in 137us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387928.822960:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787387928.830079:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945609344:0@lo:41: 00010000:00010000:0.0:1787387929.197151:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787387929.469743:0:8863:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787387929.470261:0:8863:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787387930.221529:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387930.861662:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945609472:0@lo:41: 00000100:00100000:1.0:1787387930.861766:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387930.861948:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945609472 00000100:00100000:3.0:1787387930.861959:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945609472 00000100:00100000:3.0:1787387930.862022:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787387930.862032:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945609472:12345-0@lo:41: 00000004:00000024:3.0:1787387930.862090:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787387930.862207:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945609472:12345-0@lo:41: Request processed in 177us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387930.862216:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787387930.862875:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945609472:0@lo:41: 00010000:00010000:0.0:1787387931.245445:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387931.886443:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387931.886479:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945609600:0@lo:13: 00000100:00100000:1.0:1787387931.886573:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387931.886658:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945609600 00000100:00100000:1.0:1787387931.886669:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945609600 00000100:00100000:1.0:1787387931.886733:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387931.886744:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945609600:12345-0@lo:13: 00002000:00000024:1.0:1787387931.886781:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387931.886830:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945609600:12345-0@lo:13: Request processed in 87us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387931.886838:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787387931.886863:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787387931.886920:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c108700 x1874211945609600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387931.886931:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787387931.886955:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945609600:0@lo:13: 00000100:00100000:1.0:1787387931.887234:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945609728:0@lo:13: 00000100:00100000:1.0:1787387931.887267:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387931.887308:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387931.887314:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945609856:0@lo:400: 00000100:00100000:1.0:1787387931.887372:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387931.887403:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945609728 00000100:00100000:1.0:1787387931.887407:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945609728 00000100:00100000:1.0:1787387931.887438:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787387931.887444:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945609728:12345-0@lo:13: 00002000:00000024:1.0:1787387931.887456:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387931.887487:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945609728:12345-0@lo:13: Request processed in 42us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387931.887493:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787387931.887509:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787387931.887526:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b738e8e00 x1874211945609728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387931.887539:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945609728:0@lo:13: 00000100:00100000:1.0:1787387931.889069:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945609856 00000100:00100000:1.0:1787387931.889086:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945609856 00000100:00100000:1.0:1787387931.889162:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787387931.889173:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3649:x1874211945609856:12345-0@lo:400: 00000100:00100000:1.0:1787387931.889269:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3649:x1874211945609856:12345-0@lo:400: Request processed in 97us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387931.889306:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787387931.889372:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945610112:0@lo:400: 00000100:00100000:1.0:1787387931.889411:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387931.889448:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387931.889456:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945609984:0@lo:400: 00000100:00100000:1.0:1787387931.889484:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387931.889522:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945609984 00000100:00100000:1.0:1787387931.889526:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945609984 00000100:00100000:1.0:1787387931.889558:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787387931.889566:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945609984:12345-0@lo:400: 00000100:00100000:1.0:1787387931.889604:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945609984:12345-0@lo:400: Request processed in 39us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387931.889611:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787387931.889653:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c8e00 x1874211945609984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387931.889668:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945609984:0@lo:400: 00000100:00100000:1.0:1787387931.889701:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945609856:0@lo:400: 00000100:00100000:2.0:1787387931.890023:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945610112 00000100:00100000:2.0:1787387931.890029:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945610112 00000100:00100000:2.0:1787387931.890077:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787387931.890087:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945610112:12345-0@lo:400: 00000100:00100000:2.0:1787387931.890148:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945610112:12345-0@lo:400: Request processed in 62us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387931.890154:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787387931.891099:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945610112:0@lo:400: 00000100:00100000:2.0:1787387931.896154:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387931.896189:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945610240:0@lo:400: 00000100:00100000:2.0:1787387931.896302:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387931.896428:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945610368:0@lo:400: 00000100:00100000:2.0:1787387931.896470:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387931.896519:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945610368 00000100:00100000:2.0:1787387931.896528:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945610368 00000100:00100000:2.0:1787387931.896585:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787387931.896597:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945610368:12345-0@lo:400: 00000100:00100000:2.0:1787387931.896660:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945610368:12345-0@lo:400: Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387931.896668:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787387931.896717:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945610368:0@lo:400: 00000100:00100000:2.0:1787387931.896765:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945610496:0@lo:400: 00000100:00100000:2.0:1787387931.896798:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387931.896840:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387931.896846:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945610624:0@lo:400: 00000100:00100000:2.0:1787387931.897153:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387931.897218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945610240 00000100:00100000:3.0:1787387931.897224:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945610240 00000100:00100000:3.0:1787387931.897251:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945610496 00000100:00100000:3.0:1787387931.897254:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945610496 00000100:00100000:3.0:1787387931.897297:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945610624 00000100:00100000:3.0:1787387931.897300:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945610624 00000100:00100000:3.0:1787387931.897317:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787387931.897323:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945610240:12345-0@lo:400: 00000100:00100000:3.0:1787387931.897391:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945610240:12345-0@lo:400: Request processed in 68us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387931.897397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787387931.897411:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787387931.897417:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945610496:12345-0@lo:400: 00000100:00100000:3.0:1787387931.897445:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945610496:12345-0@lo:400: Request processed in 28us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387931.897451:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787387931.897462:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787387931.897469:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945610624:12345-0@lo:400: 00000100:00100000:3.0:1787387931.897495:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945610624:12345-0@lo:400: Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387931.897510:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787387931.897542:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9d500 x1874211945610240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387931.897555:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945610240:0@lo:400: 00000100:00080000:2.0:1787387931.897667:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787387931.897673:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787387931.897691:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996a4223df80 x1874211945610624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387931.897701:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945610624:0@lo:400: 00010000:00080000:2.0:1787387931.897711:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996a4223ce00 x1874211945610496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387931.897720:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945610496:0@lo:400: 00010000:00010000:0.0:1787387932.278715:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787387932.393619:0:8965:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787387932.393897:0:8965:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787387933.293733:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787387933.490284:0:9013:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787387933.490295:0:9013:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1787387933.936886:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387933.936939:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945610752:0@lo:41: 00000100:00100000:2.0:1787387933.937009:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387933.937269:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945610752 00000100:00100000:0.0:1787387933.937278:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945610752 00000100:00100000:0.0:1787387933.937326:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787387933.937335:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945610752:12345-0@lo:41: 00000004:00000024:0.0:1787387933.937406:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787387933.939045:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945610752:12345-0@lo:41: Request processed in 1704us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387933.939057:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387933.939277:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945610752:0@lo:41: 00010000:00010000:0.0:1787387934.319006:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387935.345597:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387936.000715:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945610880:0@lo:41: 00000100:00100000:0.0:1787387936.000778:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387936.002479:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945610880 00000100:00100000:0.0:1787387936.002489:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945610880 00000100:00100000:0.0:1787387936.002542:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787387936.002551:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945610880:12345-0@lo:41: 00000004:00000024:0.0:1787387936.002584:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787387936.002651:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945610880:12345-0@lo:41: Request processed in 101us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387936.002659:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787387936.002706:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945610880:0@lo:41: 00010000:00010000:0.0:1787387936.364535:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387937.005485:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945611008:0@lo:13: 00000100:00100000:1.0:1787387937.005569:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387937.005642:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945611008 00000100:00100000:1.0:1787387937.005650:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945611008 00000100:00100000:1.0:1787387937.005700:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787387937.005709:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945611008:12345-0@lo:13: 00002000:00000024:1.0:1787387937.005742:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387937.005786:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945611008:12345-0@lo:13: Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387937.005794:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787387937.005813:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787387937.005842:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c109c00 x1874211945611008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387937.005859:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945611008:0@lo:13: 00000100:00100000:3.0:1787387937.006031:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945611264:0@lo:400: 00000100:00100000:3.0:1787387937.006064:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387937.006098:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945611776:0@lo:400: 00000100:00100000:3.0:1787387937.006134:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387937.006153:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787387937.006159:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945611392:0@lo:400: 00000100:00100000:3.0:1787387937.006180:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387937.006197:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945611904:0@lo:400: 00000100:00100000:3.0:1787387937.006215:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387937.006243:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945611264 00000100:00100000:3.0:1787387937.006247:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945611264 00000100:00100000:3.0:1787387937.006273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787387937.006279:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3649:x1874211945611264:12345-0@lo:400: 00000100:00100000:3.0:1787387937.006312:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3649:x1874211945611264:12345-0@lo:400: Request processed in 34us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387937.006318:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787387937.006367:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945611776 00000100:00100000:3.0:1787387937.006371:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945611776 00000100:00100000:3.0:1787387937.006396:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787387937.006402:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945611776:12345-0@lo:400: 00000100:00100000:3.0:1787387937.006432:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945611776:12345-0@lo:400: Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387937.006449:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787387937.006467:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945611392 00000100:00100000:3.0:1787387937.006471:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945611392 00000100:00100000:3.0:1787387937.006489:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945611904 00000100:00100000:3.0:1787387937.006492:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945611904 00000100:00100000:3.0:1787387937.006523:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387937.006529:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945611392:12345-0@lo:400: 00000100:00100000:3.0:1787387937.006559:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945611392:12345-0@lo:400: Request processed in 30us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387937.006565:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387937.006575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787387937.006581:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945611904:12345-0@lo:400: 00000100:00100000:3.0:1787387937.006616:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945611904:12345-0@lo:400: Request processed in 35us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387937.006622:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787387937.006650:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9c700 x1874211945611392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387937.006660:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945611392:0@lo:400: 00010000:00080000:3.0:1787387937.006669:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9ed80 x1874211945611904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387937.006677:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945611904:0@lo:400: 00000100:00100000:3.0:1787387937.006685:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945611264:0@lo:400: 00000100:00100000:3.0:1787387937.006693:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945611776:0@lo:400: 00000100:00100000:1.0:1787387937.006772:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945611136:0@lo:13: 00000100:00100000:1.0:1787387937.006800:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387937.006828:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945611648:0@lo:400: 00000100:00100000:1.0:1787387937.006848:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387937.006863:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945612160:0@lo:400: 00000100:00100000:1.0:1787387937.006883:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387937.006903:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787387937.006909:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945611520:0@lo:400: 00000100:00100000:1.0:1787387937.006929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387937.006944:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945612032:0@lo:400: 00000100:00100000:1.0:1787387937.006964:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387937.006986:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945612160 00000100:00100000:1.0:1787387937.006989:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945612160 00000100:00100000:1.0:1787387937.007024:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787387937.007030:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945612160:12345-0@lo:400: 00000100:00100000:1.0:1787387937.007061:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945612160:12345-0@lo:400: Request processed in 31us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387937.007067:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787387937.007094:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387937.007098:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387937.007104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945611648 00000100:00100000:1.0:1787387937.007107:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945611648 00000100:00100000:1.0:1787387937.007123:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945612032 00000100:00100000:1.0:1787387937.007126:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945612032 00000100:00100000:1.0:1787387937.007145:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387937.007151:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945611648:12345-0@lo:400: 00000100:00100000:1.0:1787387937.007177:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945611648:12345-0@lo:400: Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387937.007183:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387937.007193:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787387937.007198:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945612032:12345-0@lo:400: 00000100:00100000:1.0:1787387937.007219:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945612032:12345-0@lo:400: Request processed in 21us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387937.007225:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787387937.007238:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787387937.007247:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945611520 00000100:00100000:1.0:1787387937.007249:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945611520 00000100:00100000:1.0:1787387937.007268:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787387937.007273:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945611520:12345-0@lo:400: 00000100:00100000:1.0:1787387937.007298:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945611520:12345-0@lo:400: Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387937.007312:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787387937.007439:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945611520:0@lo:400: 00010000:00080000:1.0:1787387937.007450:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9dc00 x1874211945612032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387937.007459:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945612032:0@lo:400: 00010000:00080000:1.0:1787387937.007467:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9ca80 x1874211945611648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387937.007475:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945611648:0@lo:400: 00010000:00080000:1.0:1787387937.007483:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9fb80 x1874211945612160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387937.007490:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945612160:0@lo:400: 00000100:00100000:3.0:1787387937.007818:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945611136 00000100:00100000:3.0:1787387937.007828:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945611136 00000100:00100000:3.0:1787387937.007863:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387937.007870:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945611136:12345-0@lo:13: 00002000:00000024:3.0:1787387937.007884:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387937.007920:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945611136:12345-0@lo:13: Request processed in 51us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387937.007926:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787387937.008154:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9d500 x1874211945611136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387937.008168:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945611136:0@lo:13: 00010000:00010000:0.0:1787387937.389541:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387938.412800:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387939.052989:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387939.053021:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945612288:0@lo:41: 00000100:00100000:0.0:1787387939.053114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387939.053206:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945612288 00000100:00100000:1.0:1787387939.053225:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945612288 00000100:00100000:1.0:1787387939.053550:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787387939.053563:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945612288:12345-0@lo:41: 00000004:00000024:1.0:1787387939.053609:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787387939.055690:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945612288:12345-0@lo:41: Request processed in 2105us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387939.055709:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787387939.055767:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945612288:0@lo:41: 00010000:00010000:2.0:1787387939.453663:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387940.464302:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387941.107766:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387941.107793:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945612416:0@lo:41: 00000100:00100000:2.0:1787387941.107878:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387941.108114:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945612416 00000100:00100000:3.0:1787387941.108122:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945612416 00000100:00100000:3.0:1787387941.108181:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787387941.108190:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945612416:12345-0@lo:41: 00000004:00000024:3.0:1787387941.108222:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787387941.108271:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945612416:12345-0@lo:41: Request processed in 82us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387941.108277:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787387941.108324:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945612416:0@lo:41: 00010000:00010000:2.0:1787387941.484600:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387942.124720:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945612800:0@lo:400: 00000100:00100000:3.0:1787387942.124788:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387942.124843:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945613312:0@lo:400: 00000100:00100000:3.0:1787387942.124867:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387942.124891:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787387942.124897:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945612928:0@lo:400: 00000100:00100000:3.0:1787387942.124918:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387942.124932:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945613440:0@lo:400: 00000100:00100000:3.0:1787387942.124954:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387942.124998:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945612800 00000100:00100000:3.0:1787387942.125019:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945612800 00000100:00100000:3.0:1787387942.125082:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787387942.125091:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945612800:12345-0@lo:400: 00000100:00100000:3.0:1787387942.125146:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945612800:12345-0@lo:400: Request processed in 56us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387942.125153:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787387942.125197:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945612800:0@lo:400: 00000100:00100000:2.0:1787387942.125380:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945612672:0@lo:400: 00000100:00100000:2.0:1787387942.125409:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387942.125424:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945613184:0@lo:400: 00000100:00100000:2.0:1787387942.125441:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387942.125456:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787387942.125461:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945612544:0@lo:400: 00000100:00100000:2.0:1787387942.125485:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387942.125503:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945613056:0@lo:400: 00000100:00100000:2.0:1787387942.125522:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387942.125535:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945613568:0@lo:400: 00000100:00100000:2.0:1787387942.125553:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387942.125620:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945613312 00000100:00100000:0.0:1787387942.125624:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945613312 00000100:00100000:0.0:1787387942.125663:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945612928 00000100:00100000:0.0:1787387942.125666:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945612928 00000100:00100000:0.0:1787387942.125676:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945612672 00000100:00100000:0.0:1787387942.125678:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945612672 00000100:00100000:0.0:1787387942.125688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945613184 00000100:00100000:0.0:1787387942.125690:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945613184 00000100:00100000:0.0:1787387942.125704:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787387942.125709:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945613312:12345-0@lo:400: 00000100:00100000:0.0:1787387942.125757:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945613312:12345-0@lo:400: Request processed in 47us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387942.125763:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787387942.125776:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787387942.125782:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945612928:12345-0@lo:400: 00000100:00100000:0.0:1787387942.125807:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945612928:12345-0@lo:400: Request processed in 25us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387942.125813:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787387942.125824:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387942.125829:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945612672:12345-0@lo:400: 00000100:00100000:0.0:1787387942.125856:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945612672:12345-0@lo:400: Request processed in 27us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387942.125862:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387942.125873:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787387942.125879:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945613184:12345-0@lo:400: 00000100:00100000:0.0:1787387942.125904:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945613184:12345-0@lo:400: Request processed in 25us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387942.125909:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787387942.125935:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9df80 x1874211945612672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387942.125947:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945612672:0@lo:400: 00010000:00080000:0.0:1787387942.125956:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9c380 x1874211945613184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387942.125964:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945613184:0@lo:400: 00010000:00080000:0.0:1787387942.125996:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9c700 x1874211945612928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387942.126005:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945612928:0@lo:400: 00010000:00080000:0.0:1787387942.126019:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9ea00 x1874211945613312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387942.126026:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945613312:0@lo:400: 00000100:00100000:1.0:1787387942.126154:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945613440 00000100:00100000:1.0:1787387942.126159:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945613440 00000100:00100000:1.0:1787387942.126186:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945613568 00000100:00100000:1.0:1787387942.126189:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945613568 00000100:00100000:1.0:1787387942.126205:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387942.126211:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945613440:12345-0@lo:400: 00000100:00100000:1.0:1787387942.126247:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945613440:12345-0@lo:400: Request processed in 36us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387942.126253:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387942.126265:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387942.126270:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945613568:12345-0@lo:400: 00000100:00100000:1.0:1787387942.126300:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945613568:12345-0@lo:400: Request processed in 30us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387942.126306:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787387942.126322:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945612544 00000100:00100000:1.0:1787387942.126326:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945612544 00000100:00100000:1.0:1787387942.126366:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787387942.126373:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3652:x1874211945612544:12345-0@lo:400: 00000100:00100000:1.0:1787387942.126400:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3652:x1874211945612544:12345-0@lo:400: Request processed in 27us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387942.126405:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787387942.126463:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387942.126473:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945613696:0@lo:13: 00000100:00100000:1.0:1787387942.126501:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387942.126526:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945613696 00000100:00100000:1.0:1787387942.126530:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945613696 00000100:00100000:1.0:1787387942.126555:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787387942.126560:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945613696:12345-0@lo:13: 00002000:00000024:1.0:1787387942.126588:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387942.126620:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945613696:12345-0@lo:13: Request processed in 59us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387942.126626:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787387942.126653:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c10aa00 x1874211945613696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387942.126666:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945613696:0@lo:13: 00000100:00100000:1.0:1787387942.126687:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945612544:0@lo:400: 00010000:00080000:1.0:1787387942.126696:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9d180 x1874211945613568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387942.126703:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945613568:0@lo:400: 00000100:00100000:0.0:1787387942.126797:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945613824:0@lo:13: 00000100:00100000:0.0:1787387942.126825:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787387942.126848:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b74f9c000 x1874211945613440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387942.126856:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945613440:0@lo:400: 00000100:00080000:2.0:1787387942.126920:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387942.126925:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787387942.126927:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787387942.127071:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945613056 00000100:00100000:3.0:1787387942.127076:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945613056 00000100:00100000:3.0:1787387942.127150:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787387942.127158:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945613056:12345-0@lo:400: 00000100:00100000:3.0:1787387942.127205:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945613056:12345-0@lo:400: Request processed in 48us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387942.127211:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787387942.127265:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945613056:0@lo:400: 00000100:00100000:1.0:1787387942.127328:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945613824 00000100:00100000:1.0:1787387942.127332:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945613824 00000100:00100000:1.0:1787387942.127383:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787387942.127390:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945613824:12345-0@lo:13: 00002000:00000024:1.0:1787387942.127400:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387942.127428:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945613824:12345-0@lo:13: Request processed in 39us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387942.127434:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787387942.127967:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7389f800 x1874211945613824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387942.127997:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945613824:0@lo:13: 00010000:00010000:0.0:1787387942.511117:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787387943.301078:0:9512:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787387943.301082:0:9512:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787387943.301084:0:9512:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787387943.301213:0:9512:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff996b7f53f000 00000020:01000004:2.0:1787387943.301228:0:9512:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787387943.301241:0:9512:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787387943.301260:0:9512:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff996a420c19c0) 00000020:00000080:2.0:1787387943.301278:0:9512:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787387943.387931:0:9512:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787387943.388000:0:9512:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1787387943.434046:0:9512:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787387943.434917:0:9512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787387943.434931:0:9512:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787387943.434943:0:9512:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26817551a44742f2 00000020:01000004:3.0:1787387943.434950:0:9512:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787387943.434971:0:9512:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787387943.434974:0:9512:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787387943.434979:0:9512:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787387943.435007:0:9512:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787387943.435011:0:9512:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787387943.469414:0:9512:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787387943.469449:0:9512:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.115@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787387943.469452:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787387943.469454:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387943.469456:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387943.469457:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387943.469459:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387943.469460:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387943.469461:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387943.469463:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387943.469464:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387943.469466:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387943.469468:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787387943.469472:0:9512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787387943.469474:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787387943.469475:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387943.469477:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387943.469478:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387943.469479:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387943.469480:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387943.469481:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387943.469482:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387943.469483:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387943.469484:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387943.469485:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787387943.469511:0:9512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787387943.469528:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945613952:0@lo:253: 00000100:00100000:2.0:1787387943.469594:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.469715:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.469966:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945613952 00000100:00100000:1.0:1787387943.469974:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945613952 00000100:00100000:1.0:1787387943.470061:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787387943.470071:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:9512:x1874211945613952:12345-0@lo:253: 20000000:01000000:1.0:1787387943.470100:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787387943.470105:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787387943.470118:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787387943.470121:0:6514:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787387943.470325:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787387943.470479:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1787387943.470496:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787387943.470517:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1787387943.470524:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787387943.470537:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1787387943.470553:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1787387943.470631:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1787387943.470646:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1787387943.470648:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787387943.470664:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1787387943.470670:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787387943.470685:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1787387943.470691:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1787387943.470704:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1787387943.470710:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787387943.470721:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1787387943.470735:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1787387943.470804:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1787387943.470828:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1787387943.470830:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787387943.470845:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1787387943.470850:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787387943.470863:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1787387943.470868:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1787387943.470879:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1787387943.470884:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787387943.470895:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1787387943.470908:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1787387943.471286:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1787387943.471299:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1787387943.471301:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787387943.471313:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1787387943.471319:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787387943.471332:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1787387943.471337:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1787387943.471374:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1787387943.471381:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787387943.471394:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1787387943.471409:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1787387943.471421:0:6514:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787387943.471424:0:6514:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787387943.471428:0:6514:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787387943.471472:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787387943.471475:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787387943.472063:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1787387943.472087:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1787387943.472101:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1787387943.472276:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1787387943.472296:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1787387943.472312:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1787387943.472321:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787387943.472323:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787387943.472676:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1787387943.472694:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1787387943.472711:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1787387943.472925:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1787387943.472945:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1787387943.472970:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1787387943.472980:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787387943.472982:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787387943.473320:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1787387943.473588:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1787387943.473607:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1787387943.473623:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1787387943.473634:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787387943.473635:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787387943.473960:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1787387943.473981:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1787387943.473995:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1787387943.474146:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1787387943.474162:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1787387943.474173:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1787387943.474182:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787387943.474184:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787387943.474534:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1787387943.474566:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1787387943.474579:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787387943.474714:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787387943.474735:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1787387943.474751:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:3.0:1787387943.474766:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787387943.474784:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.474803:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b70077c00/0x26817551a44741ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44741e8 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.474811:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b74e09a00/0x26817551a4474219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474212 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.474898:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b413ff800/0x26817551a4474258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474251 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.474905:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b413ffe00/0x26817551a4474274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447426d expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.474912:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b821d7e00/0x26817551a447429e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474297 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.474926:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b821d6e00/0x26817551a44742ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44742b3 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.474933:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b74e08800/0x26817551a44742e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44742dd expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.474940:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.474978:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b74e08800/0x26817551a44742e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44742dd expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.474991:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b74e08800/0x26817551a44742e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44742dd expref: 21 pid: 6515 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.475006:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614080:0@lo:104: 00000100:00100000:3.0:1787387943.475088:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387943.475186:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b821d6e00/0x26817551a44742ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44742b3 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.475195:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b821d6e00/0x26817551a44742ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44742b3 expref: 21 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.475203:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614208:0@lo:104: 00000100:00100000:3.0:1787387943.475225:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387943.475408:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b821d7e00/0x26817551a447429e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474297 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.475417:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b821d7e00/0x26817551a447429e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474297 expref: 21 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.475433:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614336:0@lo:104: 00000100:00100000:3.0:1787387943.475458:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.475518:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945614080 00000100:00100000:0.0:1787387943.475525:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945614080 00000100:00100000:1.0:1787387943.475588:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945614208 00000100:00100000:1.0:1787387943.475596:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945614208 00000100:00100000:1.0:1787387943.475618:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787387943.475627:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6514:x1874211945614080:12345-0@lo:104: 00010000:00010000:1.0:1787387943.475638:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.475690:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787387943.475696:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6514:x1874211945614080:12345-0@lo:104: Request processed in 71us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.475703:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787387943.475720:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787387943.475727:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6514:x1874211945614208:12345-0@lo:104: 00010000:00010000:1.0:1787387943.475734:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.475764:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787387943.475768:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6514:x1874211945614208:12345-0@lo:104: Request processed in 43us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.475774:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787387943.475838:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387943.475845:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.475862:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b413fe400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787387943.475865:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.475873:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387943.475879:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.475884:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387943.475917:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.475924:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387943.475942:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.475949:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44742dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44742e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.475962:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387943.475965:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.475971:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b821d6000 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787387943.475974:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.475991:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387943.475997:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387943.476002:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387943.476015:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.476021:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387943.476044:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.476051:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b821d6000/0x26817551a44742b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44742ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.476062:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387943.476064:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387943.476066:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387943.476078:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945614464:0@lo:103: 00000100:00100000:2.0:1787387943.476109:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.476141:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945614592:0@lo:103: 00000100:00100000:2.0:1787387943.476162:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387943.476405:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b413ffe00/0x26817551a4474274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a447426d expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.476416:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b413ffe00/0x26817551a4474274 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a447426d expref: 21 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.476424:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614720:0@lo:104: 00000100:00100000:3.0:1787387943.476447:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387943.476463:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b413ff800/0x26817551a4474258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474251 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.476470:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b413ff800/0x26817551a4474258 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474251 expref: 21 pid: 6515 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.476477:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614848:0@lo:104: 00000100:00100000:3.0:1787387943.476499:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387943.476516:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b74e09a00/0x26817551a4474219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474212 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.476524:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b74e09a00/0x26817551a4474219 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474212 expref: 21 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.476531:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614976:0@lo:104: 00000100:00100000:3.0:1787387943.476554:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787387943.476584:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b70077c00/0x26817551a44741ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44741e8 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.476602:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996b70077c00/0x26817551a44741ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44741e8 expref: 21 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.476610:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945615104:0@lo:104: 00000100:00100000:3.0:1787387943.476631:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5dc8cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.476649:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614080:0@lo:104: 00000100:00100000:3.0:1787387943.476656:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614208:0@lo:104: 00000100:00100000:3.0:1787387943.476674:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945614464 00000100:00100000:3.0:1787387943.476678:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945614464 00010000:00010000:3.0:1787387943.476697:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b74e08800/0x26817551a44742e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44742dd expref: 22 pid: 6515 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.476714:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945614592 00000100:00100000:3.0:1787387943.476717:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945614592 00010000:00010000:3.0:1787387943.476728:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b821d6e00/0x26817551a44742ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44742b3 expref: 23 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.476747:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387943.476753:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3650:x1874211945614464:12345-0@lo:103: 00010000:00010000:3.0:1787387943.476762:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.476768:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b74e08800/0x26817551a44742e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44742dd expref: 23 pid: 6515 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.476778:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b74e08800/0x26817551a44742e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44742dd expref: 23 pid: 6515 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.476790:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e08800/0x26817551a44742e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44742dd expref: 23 pid: 6515 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387943.476915:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387943.476924:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:3651:x1874211945614592:12345-0@lo:103: 00010000:00010000:2.0:1787387943.476933:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387943.476945:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b821d6e00/0x26817551a44742ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44742b3 expref: 22 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.476954:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b821d6e00/0x26817551a44742ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44742b3 expref: 22 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.476964:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b821d6e00/0x26817551a44742ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44742b3 expref: 22 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.476975:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387943.477007:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3651:x1874211945614592:12345-0@lo:103: Request processed in 85us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.477013:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387943.477056:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945614592:0@lo:103: 00010000:00010000:3.0:1787387943.477092:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.477152:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:3650:x1874211945614464:12345-0@lo:103: Request processed in 398us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.477158:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787387943.477227:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787387943.477245:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.477254:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945614336 00000100:00100000:0.0:1787387943.477258:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945614336 00000100:00100000:0.0:1787387943.477275:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945614720 00000100:00100000:0.0:1787387943.477277:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945614720 00000100:00100000:0.0:1787387943.477287:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945614848 00000100:00100000:0.0:1787387943.477294:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945614848 00000100:00100000:0.0:1787387943.477305:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945614976 00000100:00100000:0.0:1787387943.477307:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945614976 00000100:00100000:0.0:1787387943.477316:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945615104 00000100:00100000:0.0:1787387943.477318:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945615104 00000100:00100000:0.0:1787387943.477327:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387943.477334:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+7:6514:x1874211945614336:12345-0@lo:104: 00010000:00010000:0.0:1787387943.477342:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477412:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787387943.477418:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+7:6514:x1874211945614336:12345-0@lo:104: Request processed in 85us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.477424:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387943.477436:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387943.477443:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+6:6514:x1874211945614720:12345-0@lo:104: 00010000:00010000:0.0:1787387943.477449:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477477:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787387943.477482:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+6:6514:x1874211945614720:12345-0@lo:104: Request processed in 40us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.477487:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387943.477497:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787387943.477502:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+5:6514:x1874211945614848:12345-0@lo:104: 00010000:00010000:0.0:1787387943.477509:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477532:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787387943.477542:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+5:6514:x1874211945614848:12345-0@lo:104: Request processed in 40us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.477548:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787387943.477561:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787387943.477566:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7d73e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6514:x1874211945614976:12345-0@lo:104: 00010000:00010000:0.0:1787387943.477574:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477600:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787387943.477605:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7d73e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6514:x1874211945614976:12345-0@lo:104: Request processed in 39us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.477610:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787387943.477648:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787387943.477654:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6514:x1874211945615104:12345-0@lo:104: 00010000:00010000:0.0:1787387943.477660:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477685:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787387943.477689:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6514:x1874211945615104:12345-0@lo:104: Request processed in 36us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.477694:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787387943.477709:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787387943.477714:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477720:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787387943.477723:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477741:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387943.477748:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.477753:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387943.477782:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477788:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387943.477800:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477807:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474297 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447429e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477898:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787387943.477901:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477907:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076a00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787387943.477910:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477917:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387943.477923:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.477935:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387943.477950:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477955:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387943.477962:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477968:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70076a00/0x26817551a447426d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474274 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477977:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787387943.477980:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477986:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b821d6c00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787387943.477989:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.477995:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387943.478001:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.478006:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387943.478017:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478022:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387943.478046:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478053:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b821d6c00/0x26817551a4474251 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474258 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478063:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387943.478065:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478071:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787387943.478074:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478082:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387943.478088:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.478093:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387943.478107:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478112:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387943.478118:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478124:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70076400/0x26817551a4474212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474219 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478131:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387943.478141:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478147:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787387943.478150:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478157:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387943.478164:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.478168:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387943.478179:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478184:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387943.478188:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478193:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a44741e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44741ef expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478206:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387943.478208:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387943.478209:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387943.478224:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945615360:0@lo:103: 00000100:00100000:0.0:1787387943.478256:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.478279:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387943.478284:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945615488:0@lo:103: 00000100:00100000:0.0:1787387943.478313:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.478335:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945615232:0@lo:103: 00000100:00100000:0.0:1787387943.478385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.478397:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945615744:0@lo:103: 00000100:00100000:0.0:1787387943.478415:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.478425:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387943.478430:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945615616:0@lo:103: 00000100:00100000:0.0:1787387943.478447:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.478465:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945615360 00000100:00100000:0.0:1787387943.478471:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945615360 00010000:00010000:0.0:1787387943.478492:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b413ffe00/0x26817551a4474274 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447426d expref: 20 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.478509:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945615488 00000100:00100000:0.0:1787387943.478512:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945615488 00010000:00010000:0.0:1787387943.478521:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b413ff800/0x26817551a4474258 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474251 expref: 21 pid: 6515 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.478532:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945615232 00000100:00100000:0.0:1787387943.478534:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945615232 00010000:00010000:0.0:1787387943.478544:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b821d7e00/0x26817551a447429e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474297 expref: 22 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.478553:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945615744 00000100:00100000:0.0:1787387943.478555:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945615744 00010000:00010000:0.0:1787387943.478564:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b70077c00/0x26817551a44741ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44741e8 expref: 23 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.478573:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945615616 00000100:00100000:0.0:1787387943.478576:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945615616 00010000:00010000:0.0:1787387943.478594:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b74e09a00/0x26817551a4474219 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474212 expref: 24 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.478607:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387943.478613:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945615360:12345-0@lo:103: 00010000:00010000:0.0:1787387943.478621:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387943.478625:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b413ffe00/0x26817551a4474274 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447426d expref: 24 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478634:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b413ffe00/0x26817551a4474274 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a447426d expref: 24 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478646:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387943.478675:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945615360:12345-0@lo:103: Request processed in 61us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.478681:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787387943.478694:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387943.478700:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3649:x1874211945615488:12345-0@lo:103: 00010000:00010000:0.0:1787387943.478707:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387943.478712:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b413ff800/0x26817551a4474258 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474251 expref: 23 pid: 6515 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478720:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b413ff800/0x26817551a4474258 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474251 expref: 23 pid: 6515 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.478729:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387943.478749:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3649:x1874211945615488:12345-0@lo:103: Request processed in 49us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.478754:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787387943.478809:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387943.478943:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387943.478952:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:3652:x1874211945615744:12345-0@lo:103: 00010000:00010000:3.0:1787387943.478960:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.478965:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff996b70077c00/0x26817551a44741ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44741e8 expref: 22 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.478974:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b70077c00/0x26817551a44741ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44741e8 expref: 22 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.478983:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.479012:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:3652:x1874211945615744:12345-0@lo:103: Request processed in 62us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.479018:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387943.479030:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387943.479046:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3652:x1874211945615616:12345-0@lo:103: 00010000:00010000:3.0:1787387943.479052:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.479056:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff996b74e09a00/0x26817551a4474219 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474212 expref: 21 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.479063:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b74e09a00/0x26817551a4474219 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474212 expref: 21 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.479072:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.479097:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3652:x1874211945615616:12345-0@lo:103: Request processed in 53us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.479103:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787387943.479136:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945615616:0@lo:103: 00000100:00100000:3.0:1787387943.479145:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945615744:0@lo:103: 00000100:00100000:3.0:1787387943.479175:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614336:0@lo:104: 00010000:00010000:3.0:1787387943.479184:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b413ffe00/0x26817551a4474274 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a447426d expref: 20 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.479194:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614720:0@lo:104: 00010000:00010000:3.0:1787387943.479203:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b413ff800/0x26817551a4474258 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474251 expref: 19 pid: 6515 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.479210:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614848:0@lo:104: 00010000:00010000:3.0:1787387943.479219:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09a00/0x26817551a4474219 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474212 expref: 18 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.479226:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945614976:0@lo:104: 00010000:00010000:3.0:1787387943.479234:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70077c00/0x26817551a44741ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44741e8 expref: 17 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.479241:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1874211945615104:0@lo:104: 00010000:00010000:3.0:1787387943.479267:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.479407:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387943.479453:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:3652:x1874211945615232:12345-0@lo:103: 00010000:00010000:0.0:1787387943.479461:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387943.479466:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff996b821d7e00/0x26817551a447429e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474297 expref: 16 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.479476:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b821d7e00/0x26817551a447429e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474297 expref: 16 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.479486:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b821d7e00/0x26817551a447429e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474297 expref: 16 pid: 6516 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.479497:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.479504:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.479517:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.479524:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.479530:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.479536:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.479540:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787387943.479544:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.479559:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387943.479639:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945614464:0@lo:103: 00010000:00010000:3.0:1787387943.479788:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.479802:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787387943.479810:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1787387943.480245:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.480255:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40030400/0x26817551a44742f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.480270:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387943.480326:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3652:x1874211945615232:12345-0@lo:103: Request processed in 1510us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.480334:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787387943.480482:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945615488:0@lo:103: 00000100:00100000:1.0:1787387943.480492:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945615360:0@lo:103: 00000100:00100000:3.0:1787387943.480576:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945615232:0@lo:103: 00000100:00100000:3.0:1787387943.485841:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+14:9512:x1874211945613952:12345-0@lo:253: Request processed in 15762us (16238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.485856:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787387943.485999:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945613952:0@lo:253: 10000000:01000000:2.0:1787387943.486015:0:9512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787387943.486019:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787387943.486021:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387943.486022:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387943.486023:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787387943.486024:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387943.486025:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387943.486027:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387943.486028:0:9512:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787387943.486030:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387943.486040:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787387943.486065:0:9512:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996b7f53f000 from lustre-OST0001 10000000:01000000:2.0:1787387943.486262:0:9512:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787387943.486267:0:9512:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787387943.486276:0:9512:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff996b72b819c0 local copy 10000000:01000000:2.0:1787387943.486288:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787387943.486322:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.486333:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.486342:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387943.486387:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945615872:0@lo:101: 00000100:00100000:2.0:1787387943.486423:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.486466:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42e08cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.486583:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945615872 00000100:00100000:3.0:1787387943.486590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945615872 00000100:00100000:3.0:1787387943.486630:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787387943.486638:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+14:9512:x1874211945615872:12345-0@lo:101: 00010000:00010000:3.0:1787387943.486650:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387943.486663:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b40031c00/0x26817551a4474307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474300 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.486685:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40031c00/0x26817551a4474307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474300 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.486696:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b40031c00/0x26817551a4474307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474300 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.486705:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031c00, rc 0) 00000100:00100000:3.0:1787387943.486733:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:9512:x1874211945615872:12345-0@lo:101: Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.486739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787387943.486812:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945615872:0@lo:101: 00010000:00010000:0.0:1787387943.486825:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.486833:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.486921:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616000:0@lo:501: 00000100:00100000:0.0:1787387943.486944:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.486963:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.487005:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945616000 00000100:00100000:3.0:1787387943.487014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945616000 00000100:00100000:3.0:1787387943.487102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787387943.487108:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:9512:x1874211945616000:12345-0@lo:501: 00000100:00100000:3.0:1787387943.487156:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:9512:x1874211945616000:12345-0@lo:501: Request processed in 48us (211us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787387943.487162:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787387943.487213:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616000:0@lo:501: 10000000:01000000:0.0:1787387943.487223:0:9512:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787387943.487237:0:9512:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787387943.487242:0:9512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487254:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487261:0:9512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487273:0:9512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787387943.487292:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996b7f53f000 00010000:00010000:0.0:1787387943.487300:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387943.487304:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487311:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b413fe400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787387943.487314:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487322:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387943.487328:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.487334:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787387943.487365:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487371:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387943.487386:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487401:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a4474300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x26817551a4474307 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487412:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387943.487413:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387943.487415:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387943.487423:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945616128:0@lo:103: 00000100:00100000:0.0:1787387943.487459:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787387943.487487:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787387943.487492:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787387943.487494:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787387943.487497:0:9512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787387943.487499:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787387943.487512:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487519:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487526:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.487534:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616256:0@lo:101: 00000100:00100000:0.0:1787387943.487553:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.487568:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945616256 00000100:00100000:0.0:1787387943.487572:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945616256 00000100:00100000:0.0:1787387943.487589:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787387943.487594:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:9512:x1874211945616256:12345-0@lo:101: 00010000:00010000:0.0:1787387943.487607:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387943.487615:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09200/0x26817551a4474315 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447430e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487631:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09200/0x26817551a4474315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447430e expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487639:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09200/0x26817551a4474315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447430e expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.487646:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09200, rc 0) 00000100:00100000:0.0:1787387943.487668:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945616256:12345-0@lo:101: Request processed in 74us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.487674:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787387943.490393:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.490433:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616256:0@lo:101: 00010000:00010000:0.0:1787387943.490470:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.490483:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.490623:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616384:0@lo:501: 00000100:00100000:0.0:1787387943.490675:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.490714:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945616384 00000100:00100000:0.0:1787387943.490720:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945616384 00000100:00100000:0.0:1787387943.490749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787387943.490757:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945616384:12345-0@lo:501: 00000100:00100000:0.0:1787387943.490874:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945616384:12345-0@lo:501: Request processed in 116us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.490881:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787387943.490910:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.490923:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616384:0@lo:501: 00000100:00100000:0.0:1787387943.490959:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616512:0@lo:503: 00000100:00100000:0.0:1787387943.490995:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.491017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945616512 00000100:00100000:0.0:1787387943.491021:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945616512 00000100:00100000:0.0:1787387943.491051:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787387943.491057:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945616512:12345-0@lo:503: 00000100:00100000:0.0:1787387943.491128:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945616512:12345-0@lo:503: Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.491135:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787387943.491165:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.491177:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616512:0@lo:503: 00000040:00080000:0.0:1787387943.492026:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787387943.492118:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616640:0@lo:502: 00000100:00100000:0.0:1787387943.492166:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.492189:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.492198:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945616640 00000100:00100000:1.0:1787387943.492203:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945616640 00000100:00100000:1.0:1787387943.492239:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787387943.492246:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945616640:12345-0@lo:502: 00000100:00100000:1.0:1787387943.492340:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945616640:12345-0@lo:502: Request processed in 94us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.492383:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787387943.492422:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616640:0@lo:502: 00000040:00080000:0.0:1787387943.492824:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787387943.492853:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787387943.492869:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787387943.492884:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787387943.492898:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787387943.492922:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787387943.492954:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616768:0@lo:502: 00000100:00100000:0.0:1787387943.492994:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.493085:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387943.498392:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945616768 00000100:00100000:2.0:1787387943.498407:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945616768 00000100:00100000:0.0:1787387943.498573:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787387943.498586:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945616768:12345-0@lo:502: 00000100:00100000:0.0:1787387943.498790:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945616768:12345-0@lo:502: Request processed in 206us (5794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.498798:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787387943.498917:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616768:0@lo:502: 00000040:00080000:2.0:1787387943.499002:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787387943.499019:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:0.0:1787387943.499469:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945616128 00000100:00100000:0.0:1787387943.499475:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945616128 00000100:00100000:0.0:1787387943.499516:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387943.499524:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:3649:x1874211945616128:12345-0@lo:103: 00010000:00010000:0.0:1787387943.499537:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387943.499555:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40031c00/0x26817551a4474307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a4474300 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.499570:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387943.499607:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3649:x1874211945616128:12345-0@lo:103: Request processed in 84us (12158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.499613:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387943.499639:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945616128:0@lo:103: 00000020:01000000:1.0:1787387943.505497:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787387943.505511:0:9523:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787387943.505518:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387943.505520:0:9523:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787387943.505529:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787387943.505579:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff996a42db19c0) 00000020:00000080:1.0:1787387943.505606:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787387943.505614:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787387943.505676:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b7f53f000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787387943.505685:0:9523:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787387943.505690:0:9523:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26817551a4474323 00010000:00010000:1.0:1787387943.514425:0:9523:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1787387943.514706:0:9523:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787387943.523050:0:9523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787387943.523623:0:9523:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787387943.528849:0:9523:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787387943.529040:0:9523:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787387943.534696:0:9523:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1787387943.534897:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787387943.536050:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787387943.536060:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387943.536066:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387943.536068:0:9523:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787387943.536071:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387943.536075:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387943.536076:0:9523:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787387943.536079:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787387943.536080:0:9523:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787387943.536100:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387943.536103:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387943.536104:0:9523:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787387943.536113:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787387943.537323:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787387943.537386:0:9512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787387943.537407:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.537421:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.537437:0:9512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b7f53f000 from 1 10000000:01000000:0.0:1787387943.537440:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387943.537474:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.537482:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.537493:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.537517:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616896:0@lo:101: 00000100:00100000:0.0:1787387943.537587:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.537640:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.537722:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945616896 00000100:00100000:3.0:1787387943.537730:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945616896 00000100:00100000:3.0:1787387943.537783:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787387943.537792:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:9512:x1874211945616896:12345-0@lo:101: 00010000:00010000:3.0:1787387943.537805:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387943.537817:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b40030c00/0x26817551a4474331 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447432a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.537840:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40030c00/0x26817551a4474331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447432a expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.537850:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b40030c00/0x26817551a4474331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447432a expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.537858:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030c00, rc 0) 00000100:00100000:3.0:1787387943.537897:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945616896:12345-0@lo:101: Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.537903:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787387943.538056:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945616896:0@lo:101: 00010000:00010000:0.0:1787387943.538069:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.538078:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.538170:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617024:0@lo:501: 00000100:00100000:0.0:1787387943.538195:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.539088:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.549504:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945617024 00000100:00100000:1.0:1787387943.549520:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945617024 00000100:00100000:1.0:1787387943.549585:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787387943.549594:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945617024:12345-0@lo:501: 00000100:00100000:1.0:1787387943.549754:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945617024:12345-0@lo:501: Request processed in 161us (11558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.549762:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787387943.551392:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617024:0@lo:501: 00000100:00100000:0.0:1787387943.551448:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617152:0@lo:503: 00000100:00100000:0.0:1787387943.551529:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.551569:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.551636:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945617152 00000100:00100000:3.0:1787387943.551643:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945617152 00000100:00100000:3.0:1787387943.551686:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787387943.551695:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945617152:12345-0@lo:503: 00000100:00100000:3.0:1787387943.551822:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945617152:12345-0@lo:503: Request processed in 126us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.551830:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787387943.551905:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617152:0@lo:503: 00000040:00080000:0.0:1787387943.552156:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787387943.552313:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617280:0@lo:502: 00000100:00100000:0.0:1787387943.552392:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.552415:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.552486:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945617280 00000100:00100000:1.0:1787387943.552490:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945617280 00000100:00100000:1.0:1787387943.552527:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787387943.552535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945617280:12345-0@lo:502: 00000100:00100000:1.0:1787387943.552622:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945617280:12345-0@lo:502: Request processed in 87us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.552630:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787387943.552753:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617280:0@lo:502: 00000040:00080000:0.0:1787387943.552938:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787387943.552967:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787387943.552988:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617408:0@lo:502: 00000100:00100000:0.0:1787387943.553023:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.553060:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.553104:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945617408 00000100:00100000:1.0:1787387943.553109:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945617408 00000100:00100000:1.0:1787387943.553142:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787387943.553149:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945617408:12345-0@lo:502: 00000100:00100000:1.0:1787387943.553335:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945617408:12345-0@lo:502: Request processed in 186us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.553343:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787387943.553490:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617408:0@lo:502: 00000040:00080000:0.0:1787387943.553534:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787387943.553543:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787387943.554987:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387943.554998:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387943.555000:0:9527:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787387943.555008:0:9527:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b7f53f000 00000020:00000080:1.0:1787387943.555011:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787387943.555023:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787387943.555050:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387943.555051:0:9527:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787387943.555054:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787387943.555281:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787387943.555316:0:9512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387943.555464:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.555477:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387943.555531:0:9512:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787387943.555534:0:9512:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996b7f53f000 10000000:01000000:0.0:1787387943.555537:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996b7f53f000 10000000:01000000:0.0:1787387943.555548:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787387943.555555:0:9512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b7f53f000 from 1 10000000:01000000:0.0:1787387943.555557:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787387943.555606:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.555615:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.555625:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387943.555649:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617536:0@lo:101: 00000100:00100000:0.0:1787387943.555709:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.555752:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.555808:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945617536 00000100:00100000:3.0:1787387943.555816:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945617536 00000100:00100000:3.0:1787387943.555861:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787387943.555869:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9512:x1874211945617536:12345-0@lo:101: 00010000:00010000:3.0:1787387943.555880:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387943.555892:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b40030000/0x26817551a447433f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474338 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.555914:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40030000/0x26817551a447433f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474338 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.555923:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b40030000/0x26817551a447433f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474338 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.555931:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030000, rc 0) 00000100:00100000:3.0:1787387943.555978:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945617536:12345-0@lo:101: Request processed in 110us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.555984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787387943.556067:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617536:0@lo:101: 00010000:00010000:2.0:1787387943.556080:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.556089:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387943.556174:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617664:0@lo:501: 00000100:00100000:2.0:1787387943.556217:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.556239:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42e08240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.556341:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945617664 00000100:00100000:3.0:1787387943.556374:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945617664 00000100:00100000:3.0:1787387943.556401:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787387943.556408:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945617664:12345-0@lo:501: 00000100:00100000:3.0:1787387943.556508:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945617664:12345-0@lo:501: Request processed in 100us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.556515:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787387943.556722:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617664:0@lo:501: 00000100:00100000:2.0:1787387943.556756:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617792:0@lo:503: 00000100:00100000:2.0:1787387943.556796:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.556849:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42e08240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.557146:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945617792 00000100:00100000:3.0:1787387943.557150:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945617792 00000100:00100000:3.0:1787387943.557181:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787387943.557188:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945617792:12345-0@lo:503: 00000100:00100000:3.0:1787387943.557413:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945617792:12345-0@lo:503: Request processed in 225us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.557421:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787387943.557532:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617792:0@lo:503: 00000040:00080000:2.0:1787387943.557773:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787387943.557833:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617920:0@lo:502: 00000100:00100000:2.0:1787387943.557872:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.557907:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42e08240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.558010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945617920 00000100:00100000:3.0:1787387943.558016:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945617920 00000100:00100000:3.0:1787387943.558054:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787387943.558061:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945617920:12345-0@lo:502: 00000100:00100000:3.0:1787387943.558146:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945617920:12345-0@lo:502: Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.558154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787387943.558325:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945617920:0@lo:502: 00000040:00080000:2.0:1787387943.558537:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787387943.558563:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787387943.558594:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787387943.558609:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787387943.558623:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787387943.558637:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787387943.558648:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787387943.558657:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787387943.558668:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787387943.558677:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787387943.558689:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787387943.558701:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787387943.558713:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787387943.558728:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787387943.558742:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787387943.558755:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787387943.558768:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787387943.558780:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787387943.558793:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787387943.558804:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787387943.558839:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787387943.558851:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787387943.558863:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787387943.558875:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787387943.558889:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787387943.558904:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787387943.558914:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787387943.558925:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787387943.558937:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787387943.558949:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787387943.558960:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787387943.558972:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787387943.558983:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787387943.559887:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787387943.559913:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787387943.559925:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787387943.559936:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1787387943.559947:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787387943.559956:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1787387943.559967:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1787387943.559978:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1787387943.559989:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1787387943.560001:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1787387943.560012:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1787387943.560022:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1787387943.560043:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1787387943.560082:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945618048:0@lo:502: 00000100:00100000:2.0:1787387943.560147:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.560174:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42e08240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387943.560308:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945618048 00000100:00100000:3.0:1787387943.560316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945618048 00000100:00100000:3.0:1787387943.560389:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787387943.560398:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945618048:12345-0@lo:502: 00000100:00100000:3.0:1787387943.560506:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945618048:12345-0@lo:502: Request processed in 108us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.560513:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787387943.560752:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945618048:0@lo:502: 00000040:00080000:2.0:1787387943.560802:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1787387943.560817:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1787387943.561961:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787387943.561975:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff996a42db3380) 00000020:00000080:1.0:1787387943.561999:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1787387943.562174:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b7f53f000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787387943.562178:0:9528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b7f53f000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787387943.562181:0:9528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b7f53f000 3 00010000:00080000:0.0:1787387943.567176:0:9528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a43026000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1787387943.569448:0:9528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1787387943.569552:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787387943.569600:0:9528:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787387943.569613:0:9528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x26817551a447434d 00000100:00080000:0.0:1787387943.569624:0:9528:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787387943.569631:0:9528:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff996a43026000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1787387943.569668:0:9528:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b74f9e680 x1874211945618176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787387943.569696:0:9528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787387943.569948:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945618688:0@lo:400: 00000100:00100000:3.0:1787387943.570012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.570052:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945619200:0@lo:400: 00000100:00100000:3.0:1787387943.570076:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.570099:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787387943.570104:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945618304:0@lo:400: 00000100:00100000:3.0:1787387943.570140:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.570157:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945618816:0@lo:400: 00000100:00100000:3.0:1787387943.570178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.570278:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945618432:0@lo:400: 00000100:00100000:3.0:1787387943.570306:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.570324:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945618944:0@lo:400: 00000100:00100000:3.0:1787387943.570369:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.570387:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787387943.570392:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945618560:0@lo:400: 00000100:00100000:3.0:1787387943.570413:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.570421:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945619072:0@lo:400: 00000100:00100000:3.0:1787387943.570435:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.570473:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945618688 00000100:00100000:3.0:1787387943.570481:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945618688 00000100:00100000:3.0:1787387943.570510:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945618432 00000100:00100000:3.0:1787387943.570513:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945618432 00000100:00100000:3.0:1787387943.570527:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787387943.570534:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945618688:12345-0@lo:400: 00000100:00100000:3.0:1787387943.570594:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945618688:12345-0@lo:400: Request processed in 60us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.570601:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787387943.570620:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787387943.570625:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945618432:12345-0@lo:400: 00000100:00100000:3.0:1787387943.570655:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945618432:12345-0@lo:400: Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.570661:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787387943.570688:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945619200 00000100:00100000:3.0:1787387943.570692:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945619200 00000100:00100000:3.0:1787387943.570715:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945619072 00000100:00100000:3.0:1787387943.570717:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945619072 00000100:00100000:3.0:1787387943.570734:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387943.570739:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945619200:12345-0@lo:400: 00000100:00100000:3.0:1787387943.570768:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945619200:12345-0@lo:400: Request processed in 30us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.570774:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787387943.570783:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387943.570788:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945619072:12345-0@lo:400: 00000100:00100000:3.0:1787387943.570810:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945619072:12345-0@lo:400: Request processed in 21us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.570815:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787387943.570831:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945618304 00000100:00100000:3.0:1787387943.570834:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945618304 00000100:00100000:3.0:1787387943.570849:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945618816 00000100:00100000:3.0:1787387943.570851:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945618816 00000100:00100000:3.0:1787387943.570860:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945618944 00000100:00100000:3.0:1787387943.570862:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945618944 00000100:00100000:3.0:1787387943.570871:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945618560 00000100:00100000:3.0:1787387943.570873:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945618560 00000100:00100000:3.0:1787387943.570884:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787387943.570891:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945618304:12345-0@lo:400: 00000100:00100000:3.0:1787387943.570917:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945618304:12345-0@lo:400: Request processed in 27us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.570923:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787387943.570932:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787387943.570937:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945618816:12345-0@lo:400: 00000100:00100000:3.0:1787387943.570968:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945618816:12345-0@lo:400: Request processed in 31us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.570973:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787387943.570983:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787387943.570988:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945618944:12345-0@lo:400: 00000100:00100000:3.0:1787387943.571009:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945618944:12345-0@lo:400: Request processed in 21us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.571014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787387943.571022:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787387943.571026:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945618560:12345-0@lo:400: 00000100:00100000:3.0:1787387943.571058:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945618560:12345-0@lo:400: Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.571064:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787387943.571112:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9bb80 x1874211945618560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387943.571126:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945618560:0@lo:400: 00010000:00080000:3.0:1787387943.571136:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9b480 x1874211945619072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387943.571143:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945619072:0@lo:400: 00000100:00100000:3.0:1787387943.571151:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945618432:0@lo:400: 00010000:00080000:3.0:1787387943.571159:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d99880 x1874211945618944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387943.571166:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945618944:0@lo:400: 00010000:00080000:3.0:1787387943.573516:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9ad80 x1874211945618304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387943.573537:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945618304:0@lo:400: 00010000:00080000:3.0:1787387943.573551:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9b100 x1874211945618816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387943.573559:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945618816:0@lo:400: 00000100:00100000:3.0:1787387943.573613:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945618688:0@lo:400: 00010000:00080000:3.0:1787387943.573624:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d98380 x1874211945619200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387943.573631:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945619200:0@lo:400: 00000020:01000004:3.0:1787387943.573865:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787387943.573881:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff996b739c99c0) 00000020:00000080:3.0:1787387943.573904:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1787387943.574074:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b7f53f000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787387943.574079:0:9528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b7f53f000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787387943.574081:0:9528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b7f53f000 3 00010000:00080000:3.0:1787387943.574110:0:9528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a42d85800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.115@tcp at head 00000100:00100000:2.0:1787387943.575647:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1874211945618176:0@lo:38: 00000100:00100000:2.0:1787387943.575715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.575795:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945618176 00000100:00100000:2.0:1787387943.575802:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945618176 00000100:00100000:2.0:1787387943.575835:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787387943.575842:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874211945618176:12345-0@lo:38: 00010000:00080000:2.0:1787387943.575868:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1787387943.575902:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x26817551a447435b 00000004:00100000:2.0:1787387943.575917:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787387943.575946:0:6522:0:(import.c:65:import_set_state_nolock()) ffff996a42fcd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387943.575994:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874211945618176:12345-0@lo:38: Request processed in 151us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.576001:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787387943.576053:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b74f9e680 x1874211945618176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387943.576064:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787387943.576071:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787387943.576079:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787387943.576084:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787387943.576086:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a43026000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787387943.576092:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1874211945618176:0@lo:38: 00010000:00010000:3.0:1787387943.580591:0:9528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1787387943.580696:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787387943.580748:0:9528:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787387943.580760:0:9528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x26817551a4474362 00000100:00080000:3.0:1787387943.580770:0:9528:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787387943.580776:0:9528:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff996a42d85800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787387943.580811:0:9528:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996a42d98380 x1874211945619328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787387943.580831:0:9528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787387943.581131:0:9530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1874211945619456:0@lo:901: 00000100:00100000:0.0:1787387943.581193:0:9530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387943.581245:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945619456 00000100:00100000:0.0:1787387943.581256:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945619456 00000100:00100000:0.0:1787387943.581311:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387943.581319:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1874211945619456:12345-0@lo:901: 00000100:00100000:0.0:1787387943.581417:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1874211945619456:12345-0@lo:901: Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387943.581424:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387943.581444:0:9530:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2a780 going to sleep for 11 seconds 00010000:00080000:0.0:1787387943.581463:0:9530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b74f9c000 x1874211945619456/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787387959 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387943.581475:0:9530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1874211945619456:0@lo:901: 00000100:00100000:2.0:1787387943.581758:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1874211945619328:0@lo:38: 00000100:00100000:2.0:1787387943.581793:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787387943.581846:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787387943.588363:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1787387943.589329:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1787387943.589385:0:9512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387943.589412:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387943.589425:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787387943.589491:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787387943.589493:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387943.589494:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387943.589496:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387943.589497:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387943.589498:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387943.589500:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387943.589501:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387943.589503:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387943.589504:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387943.589506:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787387943.589509:0:9512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787387943.589512:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787387943.589513:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387943.589514:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387943.589515:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387943.589516:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387943.589518:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387943.589519:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387943.589520:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387943.589521:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387943.589522:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387943.589522:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787387943.589547:0:9512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787387943.589564:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945619584:0@lo:253: 00000100:00100000:2.0:1787387943.589630:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387943.589671:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787387943.590319:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945619328 00000100:00100000:0.0:1787387943.590329:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945619328 00000100:00100000:0.0:1787387943.590340:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945619584 00000100:00100000:2.0:1787387943.590430:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787387943.590438:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874211945619328:12345-0@lo:38: 00010000:00080000:2.0:1787387943.590463:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1787387943.590500:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x26817551a4474369 00000004:00100000:2.0:1787387943.590514:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787387943.590541:0:6521:0:(import.c:65:import_set_state_nolock()) ffff996a42fcb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387943.590611:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874211945619328:12345-0@lo:38: Request processed in 172us (8817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387943.590618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787387943.590654:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d98380 x1874211945619328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787387953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387943.590664:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787387943.590671:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787387943.590677:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787387943.590681:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787387943.590683:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a42d85800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787387943.590689:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1874211945619328:0@lo:38: 00000100:00100000:0.0:1787387943.591284:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945619584 00000100:00100000:0.0:1787387943.591334:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787387943.591342:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945619584:12345-0@lo:253: 20000000:01000000:0.0:1787387943.591383:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787387943.591395:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787387943.596983:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787387943.597003:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787387943.597289:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9512:x1874211945619584:12345-0@lo:253: Request processed in 5943us (7653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.597301:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 20000000:01000000:1.0:1787387943.597450:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787387943.597455:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787387943.597476:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.597491:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b821d7600/0x26817551a4474266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447425f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.597500:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b821d6a00/0x26817551a44742ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44742a5 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.597508:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.597545:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b821d6a00/0x26817551a44742ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44742a5 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.597559:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b821d6a00/0x26817551a44742ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44742a5 expref: 16 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387943.597586:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945619712:0@lo:104: 00000100:00100000:1.0:1787387943.597623:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787387943.597669:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b821d7600/0x26817551a4474266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a447425f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.597690:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b821d7600/0x26817551a4474266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a447425f expref: 16 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387943.597699:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945619840:0@lo:104: 00000100:00100000:1.0:1787387943.597721:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387943.597738:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42207240 going to sleep for 11 seconds 00000100:00100000:1.0:1787387943.597754:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945619712 00000100:00100000:1.0:1787387943.597760:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945619712 00000100:00100000:1.0:1787387943.597790:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945619840 00000100:00100000:1.0:1787387943.597793:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945619840 00000100:00100000:1.0:1787387943.597806:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787387943.597813:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6536:x1874211945619712:12345-0@lo:104: 00010000:00010000:1.0:1787387943.597832:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.597873:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787387943.597879:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:6536:x1874211945619712:12345-0@lo:104: Request processed in 66us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.597885:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787387943.597898:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787387943.597904:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6536:x1874211945619840:12345-0@lo:104: 00010000:00010000:1.0:1787387943.597911:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387943.597940:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787387943.597945:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:6536:x1874211945619840:12345-0@lo:104: Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387943.597959:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787387943.597992:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945619712:0@lo:104: 00000100:00100000:1.0:1787387943.598000:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874211945619840:0@lo:104: 00010000:00010000:1.0:1787387943.598017:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387943.598110:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:530741c0-7948-4b28-86b1-ece4c1322eb9:9512:1874211945619584:0@lo:253: 10000000:01000000:2.0:1787387943.598120:0:9512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787387943.598123:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787387943.598125:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787387943.598126:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787387943.598127:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787387943.598128:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787387943.598129:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787387943.598131:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787387943.598132:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787387943.598134:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787387943.598135:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787387943.598137:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787387943.598149:0:9512:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787387943.598166:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787387943.598171:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598178:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08a00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787387943.598182:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598189:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387943.598197:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387943.598212:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387943.598243:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598249:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387943.598266:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598271:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44742a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44742ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598295:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787387943.598298:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598304:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b413fe000 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787387943.598307:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598314:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787387943.598320:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387943.598325:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787387943.598339:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598367:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787387943.598380:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598386:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b413fe000/0x26817551a447425f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474266 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598399:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387943.598401:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387943.598403:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387943.598414:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945619968:0@lo:103: 00000100:00100000:3.0:1787387943.598448:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.598480:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945620096:0@lo:103: 00000100:00100000:3.0:1787387943.598502:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387943.598531:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945619968 00000100:00100000:3.0:1787387943.598536:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945619968 00010000:00010000:3.0:1787387943.598554:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b821d6a00/0x26817551a44742ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44742a5 expref: 17 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.598584:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945620096 00000100:00100000:3.0:1787387943.598587:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945620096 00010000:00010000:3.0:1787387943.598598:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b821d7600/0x26817551a4474266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447425f expref: 18 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387943.598615:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787387943.598622:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3650:x1874211945619968:12345-0@lo:103: 00010000:00010000:3.0:1787387943.598631:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.598635:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b821d6a00/0x26817551a44742ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44742a5 expref: 18 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598645:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b821d6a00/0x26817551a44742ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44742a5 expref: 18 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598658:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b821d6a00/0x26817551a44742ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44742a5 expref: 18 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598670:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.598695:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:3650:x1874211945619968:12345-0@lo:103: Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.598701:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787387943.598714:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787387943.598726:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:3651:x1874211945620096:12345-0@lo:103: 00010000:00010000:3.0:1787387943.598733:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387943.598738:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b821d7600/0x26817551a4474266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447425f expref: 16 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598747:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b821d7600/0x26817551a4474266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a447425f expref: 16 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598756:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b821d7600/0x26817551a4474266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a447425f expref: 16 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598768:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598775:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787387943.598787:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007665635s 00010000:00010000:3.0:1787387943.598792:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598799:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598806:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598812:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598818:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077c00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787387943.598828:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598835:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598848:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598856:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387943.598881:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3651:x1874211945620096:12345-0@lo:103: Request processed in 156us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387943.598887:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787387943.598920:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945619968:0@lo:103: 00000100:00100000:3.0:1787387943.598940:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945620096:0@lo:103: 00010000:00010000:3.0:1787387943.598953:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598960:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387943.598966:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70077c00/0x26817551a4474370 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387943.599232:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1787387943.605651:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787387943.605826:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787387943.606010:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787387943.606170:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787387943.606916:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787387943.607137:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787387943.608107:0:9512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787387943.616653:0:9512:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787387943.616663:0:9512:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787387943.616703:0:9512:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787387943.616746:0:9512:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787387943.616765:0:9512:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787387943.616795:0:9512:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787387943.617665:0:9512:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787387943.617843:0:9512:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1787387944.172873:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945620224:0@lo:41: 00000100:00100000:3.0:1787387944.172943:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387944.173094:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945620224 00000100:00100000:0.0:1787387944.173101:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945620224 00000100:00100000:0.0:1787387944.173151:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787387944.173170:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945620224:12345-0@lo:41: 00000004:00000024:0.0:1787387944.173212:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787387944.173332:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945620224:12345-0@lo:41: Request processed in 162us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387944.173341:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787387944.173724:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945620224:0@lo:41: 00000020:00000004:3.0:1787387944.382798:0:9584:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787387944.383161:0:9584:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787387944.556756:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387945.583481:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387946.225839:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945620352:0@lo:41: 00000100:00100000:0.0:1787387946.225934:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387946.226063:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945620352 00000100:00100000:0.0:1787387946.226078:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945620352 00000100:00100000:0.0:1787387946.226145:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787387946.226155:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945620352:12345-0@lo:41: 00000004:00000024:0.0:1787387946.226199:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787387946.226253:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945620352:12345-0@lo:41: Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387946.226261:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787387946.226313:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945620352:0@lo:41: 00010000:00010000:3.0:1787387946.604822:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387947.244669:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945620480:0@lo:13: 00000100:00100000:3.0:1787387947.244765:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387947.245268:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945620480 00000100:00100000:1.0:1787387947.245280:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945620480 00000100:00100000:1.0:1787387947.245397:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787387947.245411:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945620480:12345-0@lo:13: 00002000:00000024:1.0:1787387947.245450:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387947.245513:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945620480:12345-0@lo:13: Request processed in 106us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.245520:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787387947.245671:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787387947.245712:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c108380 x1874211945620480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387947.245735:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945620480:0@lo:13: 00000100:00100000:2.0:1787387947.246437:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945620608:0@lo:13: 00000100:00100000:2.0:1787387947.246495:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387947.246583:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945620608 00000100:00100000:1.0:1787387947.246590:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945620608 00000100:00100000:1.0:1787387947.246647:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787387947.246655:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945620608:12345-0@lo:13: 00002000:00000024:1.0:1787387947.246676:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787387947.246827:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387947.247071:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945620608:12345-0@lo:13: Request processed in 414us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387947.247079:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787387947.247147:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9b480 x1874211945620608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387947.247163:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945620608:0@lo:13: 00010000:00010000:0.0:1787387947.628713:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387948.654671:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387948.781786:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945620864:0@lo:400: 00000100:00100000:2.0:1787387948.781863:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387948.781929:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945621376:0@lo:400: 00000100:00100000:2.0:1787387948.781955:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.781966:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945621120:0@lo:400: 00000100:00100000:2.0:1787387948.781976:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945621888:0@lo:400: 00000100:00100000:2.0:1787387948.781992:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.782025:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945620992:0@lo:400: 00000100:00100000:3.0:1787387948.782046:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945620736:0@lo:400: 00000100:00100000:0.0:1787387948.782052:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.782068:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945621504:0@lo:400: 00000100:00100000:3.0:1787387948.782077:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387948.782097:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945621248:0@lo:400: 00000100:00100000:0.0:1787387948.782102:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945620992 00000100:00100000:0.0:1787387948.782110:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945620992 00000100:00100000:3.0:1787387948.782117:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387948.782132:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945621760:0@lo:400: 00000100:00100000:0.0:1787387948.782148:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945621248 00000100:00100000:3.0:1787387948.782150:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.782157:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945621248 00000100:00100000:0.0:1787387948.782177:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787387948.782184:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945620992:12345-0@lo:400: 00000100:00100000:3.0:1787387948.782196:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945621760 00000100:00100000:3.0:1787387948.782198:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945621760 00000100:00100000:3.0:1787387948.782223:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787387948.782229:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945621760:12345-0@lo:400: 00000100:00100000:0.0:1787387948.782237:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945620992:12345-0@lo:400: Request processed in 54us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.782244:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787387948.782258:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945621760:12345-0@lo:400: Request processed in 30us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.782262:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787387948.782267:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945621248:12345-0@lo:400: 00000100:00100000:3.0:1787387948.782270:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787387948.782293:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945621248:12345-0@lo:400: Request processed in 25us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.782298:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787387948.782304:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945621248:0@lo:400: 00000100:00100000:0.0:1787387948.782314:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945620736 00010000:00080000:3.0:1787387948.782316:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311ea00 x1874211945621760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.782316:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945620736 00000100:00100000:3.0:1787387948.782326:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945621760:0@lo:400: 00000100:00100000:2.0:1787387948.786133:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945620864 00000100:00100000:2.0:1787387948.786146:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945620864 00000100:00100000:2.0:1787387948.786184:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945621376 00000100:00100000:2.0:1787387948.786187:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945621376 00000100:00100000:2.0:1787387948.786208:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945621888 00000100:00100000:2.0:1787387948.786210:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945621888 00000100:00100000:2.0:1787387948.786226:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387948.786234:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945620864:12345-0@lo:400: 00000100:00100000:2.0:1787387948.786308:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945620864:12345-0@lo:400: Request processed in 74us (4445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.786315:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387948.786331:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787387948.786337:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945621376:12345-0@lo:400: 00000100:00100000:2.0:1787387948.786378:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945621376:12345-0@lo:400: Request processed in 42us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.786392:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787387948.786404:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787387948.786410:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945621888:12345-0@lo:400: 00000100:00100000:2.0:1787387948.786436:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945621888:12345-0@lo:400: Request processed in 27us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.786441:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787387948.786465:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387948.786491:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945621632:0@lo:400: 00000100:00100000:2.0:1787387948.786520:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787387948.786545:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387948.786555:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945621632 00000100:00100000:2.0:1787387948.786558:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945621632 00000100:00100000:2.0:1787387948.786582:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387948.786588:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945621632:12345-0@lo:400: 00000100:00100000:2.0:1787387948.786617:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945621632:12345-0@lo:400: Request processed in 29us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387948.786623:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787387948.786654:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311c380 x1874211945621632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387948.786667:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945621632:0@lo:400: 00000100:00100000:0.0:1787387948.789070:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787387948.789089:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3652:x1874211945620736:12345-0@lo:400: 00000100:00100000:0.0:1787387948.789186:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3652:x1874211945620736:12345-0@lo:400: Request processed in 105us (7107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.789193:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787387948.789233:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.789269:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945622016:0@lo:400: 00000100:00100000:0.0:1787387948.789300:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387948.789341:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945620992:0@lo:400: 00000100:00100000:0.0:1787387948.789400:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945621120 00000100:00100000:0.0:1787387948.789405:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945621120 00000100:00100000:0.0:1787387948.789429:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945621504 00000100:00100000:0.0:1787387948.789431:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945621504 00000100:00100000:0.0:1787387948.789451:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945622016 00000100:00100000:0.0:1787387948.789461:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945622016 00000100:00100000:0.0:1787387948.789478:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787387948.789483:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945621120:12345-0@lo:400: 00000100:00100000:0.0:1787387948.789521:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945621120:12345-0@lo:400: Request processed in 37us (3055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.789526:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787387948.789537:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787387948.789543:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945621504:12345-0@lo:400: 00000100:00100000:0.0:1787387948.789573:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945621504:12345-0@lo:400: Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.789579:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787387948.789590:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787387948.789595:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945622016:12345-0@lo:400: 00000100:00100000:0.0:1787387948.789620:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945622016:12345-0@lo:400: Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387948.789627:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787387948.789652:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b72b58e00 x1874211945621504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.789662:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945621504:0@lo:400: 00010000:00080000:0.0:1787387948.789672:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311d180 x1874211945622016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.789679:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945622016:0@lo:400: 00010000:00080000:0.0:1787387948.789706:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223ea00 x1874211945620864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.789716:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945620864:0@lo:400: 00010000:00080000:0.0:1787387948.789738:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223f100 x1874211945621376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387948.789746:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945621376:0@lo:400: 00010000:00080000:0.0:1787387948.789757:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311c000 x1874211945621888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787387948.789764:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787387948.789764:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945621888:0@lo:400: 00010000:00080000:2.0:1787387948.789786:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223dc00 x1874211945621120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387948.789795:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945621120:0@lo:400: 00000100:00100000:3.0:1787387948.790202:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945620736:0@lo:400: 00000100:00100000:1.0:1787387949.292639:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945622144:0@lo:41: 00000100:00100000:1.0:1787387949.292712:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387949.292956:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945622144 00000100:00100000:0.0:1787387949.292964:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945622144 00000100:00100000:0.0:1787387949.293091:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787387949.293101:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945622144:12345-0@lo:41: 00000004:00000024:0.0:1787387949.293134:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787387949.293184:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945622144:12345-0@lo:41: Request processed in 84us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.295140:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787387949.295324:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945622144:0@lo:41: 00010000:00010000:1.0:1787387949.686620:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787387949.805062:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787387949.805086:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b74ea1800 from 39 10000000:01000000:2.0:1787387949.805091:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387949.805134:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.805146:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.805157:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387949.805179:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945622272:0@lo:101: 00000100:00100000:2.0:1787387949.805250:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.805310:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.805418:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945622272 00000100:00100000:3.0:1787387949.805426:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945622272 00000100:00100000:3.0:1787387949.805485:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787387949.805498:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945622272:12345-0@lo:101: 00010000:00010000:3.0:1787387949.805511:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387949.805526:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b40030400/0x26817551a447437e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474377 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.805551:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40030400/0x26817551a447437e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474377 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.805562:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b40030400/0x26817551a447437e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474377 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.805575:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030400, rc 0) 00000100:00100000:3.0:1787387949.805623:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945622272:12345-0@lo:101: Request processed in 127us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.805631:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787387949.805747:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945622272:0@lo:101: 00010000:00010000:2.0:1787387949.805761:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.805838:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387949.805909:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945622400:0@lo:501: 00000100:00100000:2.0:1787387949.805935:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.805963:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.806014:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945622400 00000100:00100000:3.0:1787387949.806018:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945622400 00000100:00100000:3.0:1787387949.806058:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787387949.806065:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945622400:12345-0@lo:501: 00000100:00100000:3.0:1787387949.806723:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945622400:12345-0@lo:501: Request processed in 656us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.806730:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787387949.808831:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945622400:0@lo:501: 00000100:00100000:1.0:1787387949.808898:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945622528:0@lo:503: 00000100:00100000:1.0:1787387949.808968:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.809019:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b59cf6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.809149:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945622528 00000100:00100000:3.0:1787387949.809155:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945622528 00000100:00100000:3.0:1787387949.809201:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787387949.809210:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945622528:12345-0@lo:503: 00000100:00100000:3.0:1787387949.809316:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945622528:12345-0@lo:503: Request processed in 106us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.809323:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787387949.809471:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945622528:0@lo:503: 00000100:00100000:3.0:1787387949.815681:0:9833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9833:1874211945622656:0@lo:502: 00000100:00100000:3.0:1787387949.815760:0:9833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.815808:0:9833:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7f579900 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.815942:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945622656 00000100:00100000:2.0:1787387949.815950:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945622656 00000100:00100000:2.0:1787387949.816008:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787387949.816018:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9833:x1874211945622656:12345-0@lo:502: 00000100:00100000:2.0:1787387949.816150:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9833:x1874211945622656:12345-0@lo:502: Request processed in 133us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.816163:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787387949.816650:0:9833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9833:1874211945622656:0@lo:502: 00000100:00100000:1.0:1787387949.816705:0:9833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9833:1874211945622784:0@lo:502: 00000100:00100000:1.0:1787387949.816741:0:9833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.816781:0:9833:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.816931:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945622784 00000100:00100000:2.0:1787387949.816936:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945622784 00000100:00100000:2.0:1787387949.816964:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787387949.816972:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9833:x1874211945622784:12345-0@lo:502: 00000100:00100000:2.0:1787387949.817068:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:9833:x1874211945622784:12345-0@lo:502: Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.817075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787387949.817160:0:9833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9833:1874211945622784:0@lo:502: 00000040:00080000:1.0:1787387949.817180:0:9833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787387949.817464:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787387949.817493:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387949.817501:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.817515:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387949.817527:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787387949.817530:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787387949.817533:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787387949.817561:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.817642:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.817651:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387949.817665:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945622912:0@lo:101: 00000100:00100000:2.0:1787387949.817704:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.817762:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517cec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787387949.826890:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945622912 00000100:00100000:1.0:1787387949.826905:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945622912 00000100:00100000:1.0:1787387949.826971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787387949.826981:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945622912:12345-0@lo:101: 00010000:00010000:1.0:1787387949.827007:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387949.827024:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70076800/0x26817551a447438c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474385 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.827052:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70076800/0x26817551a447438c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474385 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.827063:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70076800/0x26817551a447438c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474385 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.827072:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076800, rc 0) 00000100:00100000:1.0:1787387949.827150:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945622912:12345-0@lo:101: Request processed in 171us (9446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387949.827166:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787387949.827223:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945622912:0@lo:101: 00010000:00010000:1.0:1787387949.827240:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.827250:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387949.827320:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945623040:0@lo:501: 00000100:00100000:1.0:1787387949.827373:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.827467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945623040 00000100:00100000:3.0:1787387949.827472:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945623040 00000100:00100000:3.0:1787387949.827500:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787387949.827506:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945623040:12345-0@lo:501: 00000100:00100000:1.0:1787387949.827633:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.833942:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945623040:12345-0@lo:501: Request processed in 6426us (6559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.833957:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787387949.834077:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945623040:0@lo:501: 00000100:00100000:1.0:1787387949.834129:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945623168:0@lo:503: 00000100:00100000:1.0:1787387949.834177:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.834216:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.834334:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945623168 00000100:00100000:3.0:1787387949.834341:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945623168 00000100:00100000:3.0:1787387949.834426:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787387949.834434:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945623168:12345-0@lo:503: 00000100:00100000:3.0:1787387949.834543:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945623168:12345-0@lo:503: Request processed in 109us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.834558:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787387949.835450:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945623168:0@lo:503: 00000100:00100000:2.0:1787387949.836201:0:9834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9834:1874211945623296:0@lo:502: 00000100:00100000:2.0:1787387949.836258:0:9834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.836294:0:9834:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.836372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945623296 00000100:00100000:3.0:1787387949.836378:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945623296 00000100:00100000:3.0:1787387949.836473:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787387949.836482:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9834:x1874211945623296:12345-0@lo:502: 00000100:00100000:3.0:1787387949.836636:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9834:x1874211945623296:12345-0@lo:502: Request processed in 154us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.836643:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787387949.844615:0:9834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9834:1874211945623296:0@lo:502: 00000020:01000000:2.0:1787387949.844665:0:9834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387949.844679:0:9834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387949.844681:0:9834:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787387949.844686:0:9834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787387949.844688:0:9834:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787387949.844723:0:9834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9834:1874211945623424:0@lo:502: 00000100:00100000:2.0:1787387949.844870:0:9834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.844919:0:9834:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f21600 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.844998:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945623424 00000100:00100000:3.0:1787387949.845006:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945623424 00000100:00100000:3.0:1787387949.845059:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787387949.845068:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9834:x1874211945623424:12345-0@lo:502: 00000100:00100000:3.0:1787387949.845191:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:9834:x1874211945623424:12345-0@lo:502: Request processed in 123us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.845199:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787387949.846900:0:9834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9834:1874211945623424:0@lo:502: 00000020:01000000:2.0:1787387949.846942:0:9834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387949.846951:0:9834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387949.846953:0:9834:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787387949.846957:0:9834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787387949.847130:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787387949.847153:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787387949.847164:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.847175:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387949.847185:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387949.847187:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b73aa7800 from 39 10000000:01000000:1.0:1787387949.847197:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387949.847228:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.847237:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.847246:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387949.847264:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945623552:0@lo:101: 00000100:00100000:1.0:1787387949.847317:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.847392:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.848010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945623552 00000100:00100000:2.0:1787387949.848018:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945623552 00000100:00100000:2.0:1787387949.848068:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787387949.848077:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945623552:12345-0@lo:101: 00010000:00010000:2.0:1787387949.848090:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387949.848104:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b413fea00/0x26817551a447439a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474393 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.848128:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b413fea00/0x26817551a447439a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474393 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.848147:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b413fea00/0x26817551a447439a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474393 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.848155:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b413fea00, rc 0) 00000100:00100000:2.0:1787387949.848200:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945623552:12345-0@lo:101: Request processed in 124us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.848207:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787387949.848321:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945623552:0@lo:101: 00010000:00010000:1.0:1787387949.848335:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387949.848379:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387949.848447:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945623680:0@lo:501: 00000100:00100000:1.0:1787387949.848477:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.848501:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.849891:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945623680 00000100:00100000:2.0:1787387949.849903:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945623680 00000100:00100000:2.0:1787387949.849959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787387949.849968:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945623680:12345-0@lo:501: 00000100:00100000:2.0:1787387949.850119:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945623680:12345-0@lo:501: Request processed in 152us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.850127:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787387949.850170:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945623680:0@lo:501: 00000100:00100000:2.0:1787387949.850208:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945623808:0@lo:503: 00000100:00100000:2.0:1787387949.850246:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.850264:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f213c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.850276:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945623808 00000100:00100000:2.0:1787387949.850280:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945623808 00000100:00100000:2.0:1787387949.850301:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787387949.850306:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945623808:12345-0@lo:503: 00000100:00100000:2.0:1787387949.850395:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945623808:12345-0@lo:503: Request processed in 88us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.850402:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787387949.850448:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945623808:0@lo:503: 00000100:00100000:2.0:1787387949.850614:0:9835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9835:1874211945623936:0@lo:502: 00000100:00100000:2.0:1787387949.850649:0:9835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.850666:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945623936 00000100:00100000:2.0:1787387949.850670:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945623936 00000100:00100000:2.0:1787387949.850691:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787387949.850697:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:9835:x1874211945623936:12345-0@lo:502: 00000100:00100000:2.0:1787387949.850763:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:9835:x1874211945623936:12345-0@lo:502: Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.851004:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787387949.851039:0:9835:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.851052:0:9835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9835:1874211945623936:0@lo:502: 00000100:00100000:2.0:1787387949.851089:0:9835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9835:1874211945624064:0@lo:502: 00000100:00100000:2.0:1787387949.851121:0:9835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.851139:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945624064 00000100:00100000:2.0:1787387949.851142:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945624064 00000100:00100000:2.0:1787387949.851161:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787387949.851167:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:9835:x1874211945624064:12345-0@lo:502: 00000100:00100000:2.0:1787387949.851226:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:9835:x1874211945624064:12345-0@lo:502: Request processed in 59us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.851233:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787387949.851262:0:9835:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.851273:0:9835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9835:1874211945624064:0@lo:502: 00000040:00080000:2.0:1787387949.851291:0:9835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787387949.851339:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787387949.851386:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787387949.851408:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.851418:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387949.851428:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787387949.851430:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b73aa7800 from 6 10000000:01000000:2.0:1787387949.851433:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787387949.851457:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.851465:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.851474:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387949.851486:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945624192:0@lo:101: 00000100:00100000:2.0:1787387949.851511:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.851525:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.851536:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945624192 00000100:00100000:2.0:1787387949.851539:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945624192 00000100:00100000:2.0:1787387949.851561:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787387949.851568:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945624192:12345-0@lo:101: 00010000:00010000:2.0:1787387949.851575:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387949.851587:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b413ff800/0x26817551a44743a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44743a1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.851617:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b413ff800/0x26817551a44743a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44743a1 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.851627:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b413ff800/0x26817551a44743a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44743a1 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.851636:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b413ff800, rc 0) 00000100:00100000:2.0:1787387949.851665:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945624192:12345-0@lo:101: Request processed in 97us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.851671:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787387949.851702:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945624192:0@lo:101: 00010000:00010000:2.0:1787387949.851713:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.851721:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387949.851761:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945624320:0@lo:256: 00000100:00100000:2.0:1787387949.853997:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.854032:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.854051:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945624320 00000100:00100000:2.0:1787387949.854057:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945624320 00000100:00100000:2.0:1787387949.854097:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787387949.854105:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945624320:12345-0@lo:256: 20000000:01000000:2.0:1787387949.854123:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787387949.854140:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787387949.854143:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787387949.854225:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945624320:12345-0@lo:256: Request processed in 120us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.854233:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787387949.854276:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945624320:0@lo:256: 10000000:01000000:2.0:1787387949.854936:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787387949.854945:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.854956:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387949.854965:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787387949.854968:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1787387949.854972:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787387949.855012:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.855020:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.855028:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387949.855044:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945624448:0@lo:101: 00000100:00100000:2.0:1787387949.855078:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.855209:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f21b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387949.858878:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945624448 00000100:00100000:0.0:1787387949.858893:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945624448 00000100:00100000:2.0:1787387949.865490:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787387949.865505:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945624448:12345-0@lo:101: 00010000:00010000:2.0:1787387949.865523:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387949.865555:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b413fe000/0x26817551a44743b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44743af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.865586:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b413fe000/0x26817551a44743b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44743af expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.865597:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b413fe000/0x26817551a44743b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44743af expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.865606:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b413fe000, rc 0) 00000100:00100000:2.0:1787387949.865682:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945624448:12345-0@lo:101: Request processed in 181us (10602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.865689:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787387949.865734:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945624448:0@lo:101: 00010000:00010000:2.0:1787387949.865751:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.865761:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387949.865838:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945624576:0@lo:501: 00000100:00100000:2.0:1787387949.865873:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.865900:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.865914:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945624576 00000100:00100000:2.0:1787387949.865919:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945624576 00000100:00100000:2.0:1787387949.865937:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787387949.865943:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945624576:12345-0@lo:501: 00000100:00100000:2.0:1787387949.866063:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945624576:12345-0@lo:501: Request processed in 118us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.866079:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787387949.866110:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945624576:0@lo:501: 00000100:00100000:2.0:1787387949.866137:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945624704:0@lo:503: 00000100:00100000:2.0:1787387949.866174:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.866187:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.866200:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945624704 00000100:00100000:2.0:1787387949.866203:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945624704 00000100:00100000:2.0:1787387949.866220:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787387949.866225:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945624704:12345-0@lo:503: 00000100:00100000:2.0:1787387949.866300:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945624704:12345-0@lo:503: Request processed in 72us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.866306:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787387949.866342:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945624704:0@lo:503: 00000100:00100000:2.0:1787387949.866543:0:9839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9839:1874211945624832:0@lo:502: 00000100:00100000:2.0:1787387949.866576:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.866595:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945624832 00000100:00100000:2.0:1787387949.866599:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945624832 00000100:00100000:2.0:1787387949.866623:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787387949.866629:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:9839:x1874211945624832:12345-0@lo:502: 00000100:00100000:2.0:1787387949.866699:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:9839:x1874211945624832:12345-0@lo:502: Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.866705:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787387949.866732:0:9839:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4607e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.866743:0:9839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9839:1874211945624832:0@lo:502: 00000020:01000000:2.0:1787387949.866770:0:9839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787387949.866777:0:9839:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787387949.866783:0:9839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387949.866785:0:9839:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787387949.866790:0:9839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787387949.866794:0:9839:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:2.0:1787387949.866813:0:9839:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787387949.866816:0:9839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387949.866828:0:9839:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff996a420c3380) 00000020:00000080:2.0:1787387949.866850:0:9839:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787387949.866856:0:9839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787387949.866931:0:9839:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787387949.866937:0:9839:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787387949.866942:0:9839:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a44743c4 00010000:00080000:2.0:1787387949.866968:0:9839:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a4310d800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1787387949.867195:0:9839:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1787387949.867317:0:9839:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787387949.867329:0:9839:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787387949.867513:0:9839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387949.867629:0:9839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387949.867764:0:9839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787387949.867855:0:9839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787387949.872970:0:9840:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787387949.872977:0:9840:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787387949.877966:0:9839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787387949.877986:0:9839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787387949.878050:0:9839:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787387949.878079:0:9839:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a44743cb 00000100:00080000:3.0:1787387949.878090:0:9839:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787387949.878096:0:9839:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff996a4310d800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787387949.878132:0:9839:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996a42d9a680 x1874211945624960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787387949.878160:0:9839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787387949.878218:0:9839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387949.878232:0:9839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387949.878234:0:9839:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787387949.878238:0:9839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387949.878242:0:9839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387949.878244:0:9839:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787387949.878247:0:9839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787387949.878249:0:9839:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787387949.878276:0:9839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9839:1874211945625088:0@lo:502: 00000100:00100000:3.0:1787387949.878375:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.878522:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945624960:0@lo:8: 00000100:00100000:2.0:1787387949.878573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.878708:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945625088 00000100:00100000:2.0:1787387949.878714:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945625088 00000100:00100000:2.0:1787387949.878754:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787387949.878763:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:9839:x1874211945625088:12345-0@lo:502: 00000100:00100000:3.0:1787387949.878857:0:9839:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7f5799c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.879029:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:9839:x1874211945625088:12345-0@lo:502: Request processed in 266us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.879044:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787387949.879083:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945624960 00000100:00100000:2.0:1787387949.879088:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945624960 00000100:00100000:2.0:1787387949.879111:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387949.879116:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1874211945624960:12345-0@lo:8: 00010000:00080000:2.0:1787387949.879139:0:8490:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1787387949.879165:0:8490:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a44743d2 00002000:00100000:2.0:1787387949.879177:0:8490:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff996a4310c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787387949.879181:0:8490:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1787387949.879185:0:8490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787387949.879240:0:8490:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787387949.879508:0:9839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9839:1874211945625088:0@lo:502: 00000020:01000000:3.0:1787387949.879541:0:9839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387949.879547:0:9839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387949.879549:0:9839:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787387949.879554:0:9839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:0.0:1787387949.879956:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945625344:0@lo:400: 00000100:00100000:0.0:1787387949.880011:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387949.880036:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945625856:0@lo:400: 00000100:00100000:0.0:1787387949.880061:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387949.880079:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945626368:0@lo:400: 00000100:00100000:0.0:1787387949.880101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387949.880122:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787387949.880129:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945625472:0@lo:400: 00000100:00100000:0.0:1787387949.880163:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387949.880182:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945625984:0@lo:400: 00000100:00100000:0.0:1787387949.880204:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387949.880240:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945625344 00000100:00100000:0.0:1787387949.880245:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945625344 00000100:00100000:0.0:1787387949.880283:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787387949.880291:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945625344:12345-0@lo:400: 00000100:00100000:0.0:1787387949.880336:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945625344:12345-0@lo:400: Request processed in 45us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.880343:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787387949.880384:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945625856 00002000:00080000:2.0:1787387949.880983:0:8490:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787387949.881021:0:8490:0:(import.c:65:import_set_state_nolock()) ffff996a43109000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387949.881071:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3648:x1874211945624960:12345-0@lo:8: Request processed in 1952us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.881079:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787387949.881093:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945625984 00000100:00100000:2.0:1787387949.881096:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945625984 00000100:00100000:2.0:1787387949.881128:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387949.881136:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945625984:12345-0@lo:400: 00000100:00100000:2.0:1787387949.881166:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945625984:12345-0@lo:400: Request processed in 32us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.881173:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387949.881196:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945625216:0@lo:400: 00000100:00100000:2.0:1787387949.881224:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.881237:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945625728:0@lo:400: 00000100:00100000:2.0:1787387949.881269:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.881281:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945626240:0@lo:400: 00000100:00100000:2.0:1787387949.881312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.881329:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787387949.881336:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945625600:0@lo:400: 00000100:00100000:2.0:1787387949.881380:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387949.882016:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945625856 00000100:00100000:0.0:1787387949.882048:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945626368 00000100:00100000:0.0:1787387949.882052:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945626368 00000100:00100000:0.0:1787387949.882063:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945625472 00000100:00100000:0.0:1787387949.882066:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945625472 00000100:00100000:0.0:1787387949.882076:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945625216 00000100:00100000:0.0:1787387949.882078:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945625216 00000100:00100000:0.0:1787387949.882088:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945625728 00000100:00100000:0.0:1787387949.882090:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945625728 00000100:00100000:0.0:1787387949.882100:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945626240 00000100:00100000:0.0:1787387949.882103:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945626240 00000100:00100000:0.0:1787387949.882116:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787387949.882123:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945625856:12345-0@lo:400: 00000100:00100000:0.0:1787387949.882170:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945625856:12345-0@lo:400: Request processed in 47us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.882176:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787387949.882190:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787387949.882195:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945626368:12345-0@lo:400: 00000100:00100000:0.0:1787387949.882243:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945626368:12345-0@lo:400: Request processed in 48us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.882249:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787387949.882261:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787387949.882266:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945625472:12345-0@lo:400: 00000100:00100000:0.0:1787387949.882292:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945625472:12345-0@lo:400: Request processed in 27us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.882297:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787387949.882308:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787387949.882313:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945625216:12345-0@lo:400: 00000100:00100000:0.0:1787387949.882333:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945625216:12345-0@lo:400: Request processed in 21us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.882338:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787387949.882375:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787387949.882381:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945625728:12345-0@lo:400: 00000100:00100000:0.0:1787387949.882595:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945625728:12345-0@lo:400: Request processed in 214us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.882602:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787387949.882614:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787387949.882620:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945626240:12345-0@lo:400: 00000100:00100000:0.0:1787387949.882646:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945626240:12345-0@lo:400: Request processed in 27us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.882652:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787387949.889246:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945626112:0@lo:400: 00000100:00100000:2.0:1787387949.889310:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787387949.889379:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311ed80 x1874211945625216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387949.889393:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945625216:0@lo:400: 00010000:00080000:2.0:1787387949.889407:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311f100 x1874211945625728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387949.889415:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945625728:0@lo:400: 00010000:00080000:2.0:1787387949.889427:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311c380 x1874211945626240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387949.889434:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945626240:0@lo:400: 00000020:01000000:2.0:1787387949.889471:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1787387949.889500:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787387949.889511:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.889522:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387949.889545:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787387949.889547:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b46a34000 from 39 10000000:01000000:2.0:1787387949.889550:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387949.889584:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.889592:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.889603:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387949.889620:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4337b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945626496:0@lo:101: 00000100:00100000:2.0:1787387949.889650:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.889676:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517e8000 going to sleep for 11 seconds 00000100:00080000:2.0:1787387949.889704:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387949.889718:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945626112 00000100:00100000:2.0:1787387949.889724:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945626112 00000100:00100000:2.0:1787387949.890878:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387949.890893:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945626112:12345-0@lo:400: 00000100:00100000:2.0:1787387949.890962:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945626112:12345-0@lo:400: Request processed in 75us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.890969:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787387949.891016:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945626496 00000100:00100000:2.0:1787387949.891022:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945626496 00000100:00100000:2.0:1787387949.891051:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787387949.891057:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945626496:12345-0@lo:101: 00010000:00010000:2.0:1787387949.891066:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387949.891098:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e4c00/0x26817551a44743e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44743d9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.891121:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e4c00/0x26817551a44743e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44743d9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.891132:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e4c00/0x26817551a44743e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44743d9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.891140:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4c00, rc 0) 00000100:00100000:2.0:1787387949.891170:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945626496:12345-0@lo:101: Request processed in 112us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.891175:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1787387949.891202:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387949.891225:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4337b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945626496:0@lo:101: 00010000:00010000:2.0:1787387949.891239:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.891248:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387949.891740:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945625600 00000100:00100000:0.0:1787387949.891745:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945625600 00000100:00100000:2.0:1787387949.891968:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4337b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945626624:0@lo:501: 00000100:00100000:2.0:1787387949.892021:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.892088:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2240 going to sleep for 11 seconds 00010000:00080000:2.0:1787387949.892117:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9a680 x1874211945624960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387949.892128:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787387949.892134:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787387949.892142:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787387949.892155:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787387949.892159:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a4310d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787387949.892174:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787387949.892181:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945624960:0@lo:8: 00000100:00100000:2.0:1787387949.892219:0:9841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4337b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874211945626752:0@lo:700: 00000100:00100000:2.0:1787387949.892246:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.892263:0:9841:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2840 going to sleep for 11 seconds 00000004:00080000:2.0:1787387949.892276:0:9840:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787387949.892367:0:9840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 271415019758ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787387949.892375:0:9840:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787387949.892874:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945626752 00000100:00100000:0.0:1787387949.892886:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945626752 00000100:00100000:0.0:1787387949.892932:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387949.892942:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9841:x1874211945626752:12345-0@lo:700: 00000100:00100000:0.0:1787387949.892977:0:8444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1874211945626880:0@lo:700: 00000100:00100000:0.0:1787387949.893023:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387949.893040:0:8444:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ee540 going to sleep for 11 seconds 00000100:00080000:0.0:1787387949.893051:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387949.893079:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945626880 00000100:00100000:0.0:1787387949.893083:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945626880 00000100:00100000:0.0:1787387949.893110:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787387949.893116:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1874211945626880:12345-0@lo:700: 00010000:00080000:0.0:1787387949.893217:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311fb80 x1874211945625472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387949.893229:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945625472:0@lo:400: 00010000:00080000:0.0:1787387949.893242:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311f480 x1874211945625984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387949.893250:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945625984:0@lo:400: 00000100:00100000:0.0:1787387949.893262:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945625344:0@lo:400: 00010000:00080000:0.0:1787387949.893273:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311d880 x1874211945625856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387949.893280:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945625856:0@lo:400: 00010000:00080000:0.0:1787387949.893290:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311c000 x1874211945626368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387949.893297:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945626368:0@lo:400: 00000100:00100000:0.0:1787387949.893378:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787387949.893387:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945625600:12345-0@lo:400: 00000100:00100000:0.0:1787387949.893429:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945625600:12345-0@lo:400: Request processed in 43us (12047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.893437:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787387949.899828:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945626624 00000100:00100000:3.0:1787387949.899842:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945626624 00000100:00100000:3.0:1787387949.899887:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787387949.899896:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945626624:12345-0@lo:501: 00000100:00100000:3.0:1787387949.900065:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945626624:12345-0@lo:501: Request processed in 169us (8042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.900073:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787387949.900127:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4337b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945626624:0@lo:501: 00000100:00100000:3.0:1787387949.900173:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627008:0@lo:503: 00000100:00100000:3.0:1787387949.900219:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.900245:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7f579900 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.900257:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945627008 00000100:00100000:3.0:1787387949.900261:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945627008 00000100:00100000:3.0:1787387949.900277:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787387949.900289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945627008:12345-0@lo:503: 00000100:00100000:3.0:1787387949.900383:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945627008:12345-0@lo:503: Request processed in 92us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.900389:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787387949.900427:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627008:0@lo:503: 40000000:02000000:0.0:1787387949.901128:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1787387949.909510:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945625600:0@lo:400: 00010000:00080000:2.0:1787387949.909531:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311ca80 x1874211945626112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387949.909541:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945626112:0@lo:400: 00000004:00080000:3.0:1787387949.911037:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787387949.912872:0:9842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4337b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9842:1874211945627136:0@lo:502: 00000100:00100000:2.0:1787387949.912973:0:9842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.913028:0:9842:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.913080:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945627136 00000100:00100000:3.0:1787387949.913088:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945627136 00000100:00100000:3.0:1787387949.913139:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787387949.913147:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:9842:x1874211945627136:12345-0@lo:502: 00000100:00100000:3.0:1787387949.913271:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:9842:x1874211945627136:12345-0@lo:502: Request processed in 124us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.913280:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787387949.913408:0:9842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4337b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9842:1874211945627136:0@lo:502: 00000100:00100000:2.0:1787387949.913467:0:9842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4337b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9842:1874211945627264:0@lo:502: 00000100:00100000:2.0:1787387949.913501:0:9842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.913519:0:9842:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.913733:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945627264 00000100:00100000:3.0:1787387949.913738:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945627264 00000100:00100000:3.0:1787387949.913769:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787387949.913777:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:9842:x1874211945627264:12345-0@lo:502: 00000100:00100000:3.0:1787387949.913843:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:9842:x1874211945627264:12345-0@lo:502: Request processed in 66us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.913850:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787387949.913928:0:9842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4337b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9842:1874211945627264:0@lo:502: 00000040:00080000:2.0:1787387949.913946:0:9842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787387949.914098:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787387949.914117:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787387949.914126:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.914136:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387949.914157:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787387949.914159:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b46a34000 from 6 10000000:01000000:3.0:1787387949.914162:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787387949.914183:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.914191:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.914200:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387949.914213:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627392:0@lo:101: 00000100:00100000:3.0:1787387949.914242:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.914273:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.914470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945627392 00000100:00100000:2.0:1787387949.914475:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945627392 00000100:00100000:2.0:1787387949.914506:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787387949.914513:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945627392:12345-0@lo:101: 00010000:00010000:2.0:1787387949.914521:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387949.914532:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e4e00/0x26817551a44743ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44743e7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.914552:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e4e00/0x26817551a44743ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44743e7 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.914562:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e4e00/0x26817551a44743ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44743e7 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.914570:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4e00, rc 0) 00000100:00100000:2.0:1787387949.914599:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945627392:12345-0@lo:101: Request processed in 86us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.914605:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787387949.914680:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627392:0@lo:101: 00010000:00010000:3.0:1787387949.914691:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.914699:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387949.914742:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627520:0@lo:256: 00000100:00100000:3.0:1787387949.914772:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.914795:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.916521:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945627520 00000100:00100000:2.0:1787387949.916535:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945627520 00000100:00100000:2.0:1787387949.916583:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787387949.916593:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945627520:12345-0@lo:256: 20000000:01000000:2.0:1787387949.916615:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787387949.916632:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787387949.916635:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787387949.916757:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945627520:12345-0@lo:256: Request processed in 165us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.916765:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787387949.917739:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627520:0@lo:256: 10000000:01000000:3.0:1787387949.917801:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787387949.917818:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.917830:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387949.917839:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787387949.917842:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787387949.917844:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787387949.917875:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.917883:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.917892:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387949.917911:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627648:0@lo:101: 00000100:00100000:3.0:1787387949.917953:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.917998:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.918495:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945627648 00000100:00100000:2.0:1787387949.918502:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945627648 00000100:00100000:2.0:1787387949.918544:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787387949.918560:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945627648:12345-0@lo:101: 00010000:00010000:2.0:1787387949.918572:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387949.918584:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e4400/0x26817551a44743fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44743f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.918606:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e4400/0x26817551a44743fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44743f5 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.918616:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e4400/0x26817551a44743fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44743f5 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387949.918625:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4400, rc 0) 00000100:00100000:2.0:1787387949.918668:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945627648:12345-0@lo:101: Request processed in 110us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.918675:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787387949.919327:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1874211945626880:12345-0@lo:700: Request processed in 26208us (26301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.919336:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787387949.919561:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c56a00 x1874211945626880/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787387965 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387949.919574:0:8444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1874211945626880:0@lo:700: 40000000:02000000:0.0:1787387949.919584:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1787387949.920774:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627648:0@lo:101: 00010000:00010000:3.0:1787387949.920796:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.920808:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387949.920889:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627776:0@lo:501: 00000100:00100000:3.0:1787387949.920953:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.920997:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.921017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945627776 00000100:00100000:3.0:1787387949.921022:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945627776 00000100:00100000:3.0:1787387949.921057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787387949.921065:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945627776:12345-0@lo:501: 00000100:00100000:3.0:1787387949.921180:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945627776:12345-0@lo:501: Request processed in 115us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.921188:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787387949.921221:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627776:0@lo:501: 00000100:00100000:3.0:1787387949.921244:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627904:0@lo:503: 00000100:00100000:3.0:1787387949.921284:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.921297:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.921309:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945627904 00000100:00100000:3.0:1787387949.921312:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945627904 00000100:00100000:3.0:1787387949.921333:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787387949.921339:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945627904:12345-0@lo:503: 00000100:00100000:3.0:1787387949.922768:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945627904:12345-0@lo:503: Request processed in 1423us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.922777:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787387949.922839:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945627904:0@lo:503: 00000100:00100000:2.0:1787387949.929092:0:9843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4337b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9843:1874211945628032:0@lo:502: 00000100:00100000:2.0:1787387949.929271:0:9843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.929313:0:9843:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.930121:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945628032 00000100:00100000:3.0:1787387949.930130:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945628032 00000100:00100000:3.0:1787387949.930188:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787387949.930199:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:9843:x1874211945628032:12345-0@lo:502: 00000100:00100000:3.0:1787387949.930340:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:9843:x1874211945628032:12345-0@lo:502: Request processed in 142us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.930372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787387949.930404:0:9843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4337b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9843:1874211945628032:0@lo:502: 00000020:01000000:2.0:1787387949.930436:0:9843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787387949.930444:0:9843:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787387949.930450:0:9843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387949.930452:0:9843:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787387949.930458:0:9843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787387949.930461:0:9843:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:2.0:1787387949.930483:0:9843:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787387949.930485:0:9843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787387949.930508:0:9843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff996a4338cd40) 00000020:00000080:2.0:1787387949.930536:0:9843:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1787387949.930544:0:9843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787387949.930828:0:9843:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787387949.930835:0:9843:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787387949.930841:0:9843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a447440a 00010000:00080000:2.0:1787387949.930868:0:9843:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a4339d800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1787387949.931131:0:9843:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1787387949.932708:0:9843:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787387949.932726:0:9843:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787387949.933707:0:9843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387949.933910:0:9843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787387949.934052:0:9843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787387949.934146:0:9843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787387949.937482:0:9844:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787387949.937489:0:9844:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787387949.939580:0:9843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787387949.939595:0:9843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787387949.941518:0:9843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787387949.941558:0:9843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a4474411 00000100:00080000:0.0:1787387949.941570:0:9843:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787387949.941577:0:9843:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff996a4339d800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1787387949.941614:0:9843:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996a41c56a00 x1874211945628160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787387949.941751:0:9843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787387949.941845:0:9843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387949.941863:0:9843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387949.941865:0:9843:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787387949.941869:0:9843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387949.941873:0:9843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387949.941874:0:9843:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787387949.941877:0:9843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787387949.941879:0:9843:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787387949.941907:0:9843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9843:1874211945628288:0@lo:502: 00000100:00100000:0.0:1787387949.941982:0:9843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387949.942029:0:9843:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431eec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.942139:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945628160:0@lo:8: 00000100:00100000:2.0:1787387949.942187:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.942223:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945628288 00000100:00100000:2.0:1787387949.942230:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945628288 00000100:00100000:2.0:1787387949.942267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787387949.942275:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:9843:x1874211945628288:12345-0@lo:502: 00000100:00100000:2.0:1787387949.942421:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:9843:x1874211945628288:12345-0@lo:502: Request processed in 146us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.942429:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787387949.942471:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945628160 00000100:00100000:2.0:1787387949.942475:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945628160 00000100:00100000:2.0:1787387949.942495:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787387949.942499:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1874211945628160:12345-0@lo:8: 00010000:00080000:2.0:1787387949.942523:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1787387949.942562:0:8437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a4474418 00002000:00100000:2.0:1787387949.942576:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff996a4339e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787387949.942585:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787387949.942588:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787387949.943017:0:9843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:9843:1874211945628288:0@lo:502: 00000020:01000000:0.0:1787387949.943043:0:9843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387949.943049:0:9843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387949.943050:0:9843:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787387949.943054:0:9843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00002000:00080000:2.0:1787387949.943267:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000020:01000000:3.0:1787387949.943418:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1787387949.943441:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787387949.943452:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.943463:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387949.943474:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787387949.943477:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff996b72b819c0 from 1 10000000:01000000:3.0:1787387949.943479:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787387949.943505:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.943513:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.943521:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387949.943537:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945628416:0@lo:101: 00000100:00100000:3.0:1787387949.943580:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787387949.943587:0:8437:0:(import.c:65:import_set_state_nolock()) ffff996a43398800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787387949.943610:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:3.0:1787387949.943627:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945628416 00000100:00100000:3.0:1787387949.943631:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945628416 00000100:00100000:2.0:1787387949.943653:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1874211945628160:12345-0@lo:8: Request processed in 1150us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387949.943663:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787387949.943667:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787387949.943676:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945628416:12345-0@lo:101: 00010000:00010000:3.0:1787387949.943685:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387949.943705:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b414a2c00/0x26817551a4474426 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447441f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787387949.943714:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c56a00 x1874211945628160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787387959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387949.943724:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00010000:3.0:1787387949.943726:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b414a2c00/0x26817551a4474426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447441f expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787387949.943732:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00010000:00010000:3.0:1787387949.943739:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b414a2c00/0x26817551a4474426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447441f expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787387949.943741:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787387949.943749:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00010000:00010000:3.0:1787387949.943751:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b414a2c00, rc 0) 00000100:00080000:2.0:1787387949.943754:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a4339d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787387949.943769:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787387949.943775:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945628160:0@lo:8: 00000100:00100000:3.0:1787387949.943787:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945628416:12345-0@lo:101: Request processed in 112us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.943796:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787387949.943830:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945628416:0@lo:101: 00010000:00010000:3.0:1787387949.943841:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387949.943849:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387949.943893:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945628544:0@lo:501: 00000100:00100000:3.0:1787387949.943916:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.943939:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:2.0:1787387949.944533:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945628544 00000100:00100000:2.0:1787387949.944540:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945628544 00000001:00100000:0.0:1787387949.947053:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787387949.947180:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9841:x1874211945626752:12345-0@lo:700: Request processed in 54235us (54927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.947191:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787387949.947248:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4337b100 x1874211945626752/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787387965 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387949.947261:0:9841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4337b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874211945626752:0@lo:700: 00000004:00080000:0.0:1787387949.947361:0:9844:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787387949.947518:0:9844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 271470170685ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787387949.947525:0:9844:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787387949.949052:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787387949.949247:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787387949.949263:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945628544:12345-0@lo:501: 00000100:00100000:2.0:1787387949.950292:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945628544:12345-0@lo:501: Request processed in 1031us (6370us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387949.950304:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787387949.950677:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945628544:0@lo:501: 10000000:01000000:0.0:1787387949.950722:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787387949.950732:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387949.950751:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387949.959118:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387949.959140:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945628672:0@lo:13: 00000100:00100000:1.0:1787387949.959206:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787387949.959242:0:9845:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787387949.959264:0:9845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9845:1874211945628800:0@lo:7: 00000100:00100000:1.0:1787387949.959302:0:9845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.959328:0:9845:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787387949.959724:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945628800 00000100:00100000:0.0:1787387949.959732:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945628800 00000100:00100000:0.0:1787387949.959798:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787387949.959807:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9845:x1874211945628800:12345-0@lo:7: 00000100:00080000:1.0:1787387949.960252:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387949.961153:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945628672 00000100:00100000:3.0:1787387949.961161:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945628672 00000100:00100000:3.0:1787387949.961199:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787387949.961208:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1874211945628672:12345-0@lo:13: 00002000:00000024:3.0:1787387949.961231:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:3.0:1787387949.961299:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1874211945628672:12345-0@lo:13: Request processed in 92us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387949.961313:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787387949.961388:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c108e00 x1874211945628672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387949.961408:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945628672:0@lo:13: 00000004:00080000:1.0:1787387949.968248:0:9841:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787387949.968278:0:9841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874211945629056:0@lo:7: 00000100:00100000:1.0:1787387949.968343:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.968392:0:9841:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387949.968407:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945628928:0@lo:13: 00000100:00100000:1.0:1787387949.968429:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.968462:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945629056 00000100:00100000:1.0:1787387949.968468:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945629056 00000100:00100000:1.0:1787387949.968505:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787387949.968513:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9841:x1874211945629056:12345-0@lo:7: 00000100:00100000:1.0:1787387949.968557:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945628928 00000100:00100000:1.0:1787387949.968560:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945628928 00000100:00100000:1.0:1787387949.968580:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787387949.968585:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874211945628928:12345-0@lo:13: 00002000:00000024:1.0:1787387949.968596:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:1.0:1787387949.968632:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874211945628928:12345-0@lo:13: Request processed in 46us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387949.968639:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787387949.968674:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b738e8700 x1874211945628928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387949.968690:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945628928:0@lo:13: 00002000:00080000:0.0:1787387949.974920:0:8490:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787387949.974928:0:8490:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787387949.975031:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9845:x1874211945628800:12345-0@lo:7: Request processed in 15222us (15726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.975041:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787387949.975914:0:9845:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c0c9500 x1874211945628800/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787387965 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387949.975930:0:9845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9845:1874211945628800:0@lo:7: 00000004:00080000:2.0:1787387949.975952:0:9845:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787387949.976002:0:9845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9845:1874211945629184:0@lo:5: 00000100:00100000:2.0:1787387949.976042:0:9845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387949.976067:0:9845:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387949.980579:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945629184 00000100:00100000:0.0:1787387949.980592:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945629184 00000100:00100000:0.0:1787387949.980646:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787387949.980656:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9845:x1874211945629184:12345-0@lo:5: 00002000:00080000:0.0:1787387949.980684:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787387949.980688:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:1.0:1787387949.983733:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787387949.983744:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787387949.983848:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9841:x1874211945629056:12345-0@lo:7: Request processed in 15331us (15501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387949.983866:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000001:00080000:0.0:1787387949.985065:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787387949.985077:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1787387949.985271:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b738eb480 x1874211945629056/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787387965 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387949.985286:0:9841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874211945629056:0@lo:7: 00000004:00080000:3.0:1787387949.985298:0:9841:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787387949.985335:0:9841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874211945629312:0@lo:5: 00000100:00100000:3.0:1787387949.985393:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.985416:0:9841:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:1.0:1787387949.985885:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9845:x1874211945629184:12345-0@lo:5: Request processed in 5227us (9839us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787387949.985895:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787387949.985919:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945629312 00000100:00100000:1.0:1787387949.985924:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945629312 00000100:00100000:1.0:1787387949.985962:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787387949.985969:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9841:x1874211945629312:12345-0@lo:5: 00002000:00080000:1.0:1787387949.986004:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787387949.986039:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9841:x1874211945629312:12345-0@lo:5: Request processed in 70us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387949.986045:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787387949.986077:0:9845:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43378380 x1874211945629184/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387965 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387949.986086:0:9845:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787387949.986091:0:9845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9845:1874211945629184:0@lo:5: 00000004:00080000:1.0:1787387949.986101:0:9845:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00010000:00080000:3.0:1787387949.986129:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9b800 x1874211945629312/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387965 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387949.986136:0:9845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9845:1874211945629440:0@lo:700: 00000100:00100000:3.0:1787387949.986144:0:9841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874211945629312:0@lo:5: 00000004:00080000:3.0:1787387949.986153:0:9841:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787387949.986177:0:9841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874211945629568:0@lo:5: 00000100:00100000:1.0:1787387949.986184:0:9845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387949.986209:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387949.986216:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945629440 00000100:00100000:1.0:1787387949.986221:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945629440 00000100:00100000:3.0:1787387949.986230:0:9841:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:1.0:1787387949.986255:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787387949.986264:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9845:x1874211945629440:12345-0@lo:700: 00000100:00100000:1.0:1787387949.986409:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945629568 00000100:00100000:1.0:1787387949.986414:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945629568 00000100:00100000:1.0:1787387949.986443:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787387949.986461:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9841:x1874211945629568:12345-0@lo:5: 00002000:00080000:1.0:1787387949.986485:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1787387949.987775:0:9845:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787387949.998328:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9841:x1874211945629568:12345-0@lo:5: Request processed in 11861us (12111us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787387949.998342:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787387949.998534:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9b800 x1874211945629568/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387965 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387949.998551:0:9841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9841:1874211945629568:0@lo:5: 00000004:00080000:0.0:1787387949.998564:0:9841:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787387949.998602:0:9841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9841:1874211945629696:0@lo:900: 00000100:00100000:0.0:1787387949.998662:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387949.998686:0:9841:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387949.998709:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945629696 00000100:00100000:0.0:1787387949.998715:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945629696 00000100:00100000:0.0:1787387949.998761:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787387949.998770:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9841:x1874211945629696:12345-0@lo:900: 00000100:00100000:0.0:1787387949.998819:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9841:x1874211945629696:12345-0@lo:900: Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387949.998825:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787387949.998856:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c54000 x1874211945629696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787387965 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387949.998867:0:9841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9841:1874211945629696:0@lo:900: 00000001:00080000:0.0:1787387950.005265:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787387950.006215:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9845:x1874211945629440:12345-0@lo:700: Request processed in 19946us (20027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387950.006228:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787387950.006314:0:9845:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b738e8700 x1874211945629440/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787387965 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387950.006328:0:9845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9845:1874211945629440:0@lo:700: 00000004:02000040:1.0:1787387950.010004:0:9845:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1787387950.014087:0:9845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9845:1874211945629824:0@lo:5: 00000100:00100000:1.0:1787387950.014154:0:9845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387950.014291:0:9845:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787387950.014910:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945629824 00000100:00100000:0.0:1787387950.014918:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945629824 00000100:00100000:0.0:1787387950.014973:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787387950.014983:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9845:x1874211945629824:12345-0@lo:5: 00002000:00080000:1.0:1787387950.028418:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787387950.028436:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1787387950.036040:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9845:x1874211945629824:12345-0@lo:5: Request processed in 21050us (21877us total) trans 4294967299 rc 0/0 00010000:00080000:2.0:1787387950.036049:0:9845:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b738e8700 x1874211945629824/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787387966 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387950.036059:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787387950.036075:0:9845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9845:1874211945629824:0@lo:5: 00000004:00080000:2.0:1787387950.036092:0:9845:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:3.0:1787387950.224466:0:9884:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787387950.700503:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787387951.085934:0:9936:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787387951.086193:0:9936:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787387951.344537:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387951.344559:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945629952:0@lo:41: 00000100:00100000:2.0:1787387951.344637:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387951.344697:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945629952 00000100:00100000:2.0:1787387951.344703:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945629952 00000100:00100000:2.0:1787387951.344742:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787387951.344750:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945629952:12345-0@lo:41: 00000004:00000024:2.0:1787387951.344889:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787387951.344927:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945629952:12345-0@lo:41: Request processed in 177us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387951.344934:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787387951.345003:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945629952:0@lo:41: 00010000:00010000:0.0:1787387951.725536:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787387951.984177:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1787387952.364656:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387952.364695:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945630080:0@lo:13: 00000100:00100000:2.0:1787387952.364760:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387952.364962:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387952.364983:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945630208:0@lo:13: 00000100:00100000:0.0:1787387952.365017:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387952.365073:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945630080 00000100:00100000:3.0:1787387952.365085:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945630080 00000100:00100000:1.0:1787387952.365114:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945630208 00000100:00100000:1.0:1787387952.365121:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945630208 00000100:00100000:3.0:1787387952.365148:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787387952.365159:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945630080:12345-0@lo:13: 00002000:00000024:3.0:1787387952.365192:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387952.365246:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945630080:12345-0@lo:13: Request processed in 89us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387952.365253:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787387952.365268:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387952.365273:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945630208:12345-0@lo:13: 00002000:00000024:3.0:1787387952.365281:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387952.365314:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945630208:12345-0@lo:13: Request processed in 41us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387952.365319:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787387952.365403:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9a680 x1874211945630080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787387952.365403:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43804000 x1874211945630208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387952.365440:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945630080:0@lo:13: 00000100:00100000:1.0:1787387952.365441:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945630208:0@lo:13: 00000100:00080000:0.0:1787387952.365592:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787387952.751778:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387953.773330:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787387954.035044:0:10038:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787387954.036079:0:10038:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787387954.422170:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945630336:0@lo:41: 00000100:00100000:2.0:1787387954.422236:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387954.422372:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945630336 00000100:00100000:0.0:1787387954.422387:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945630336 00000100:00100000:0.0:1787387954.422439:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787387954.422447:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945630336:12345-0@lo:41: 00000004:00000024:0.0:1787387954.422480:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787387954.422526:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945630336:12345-0@lo:41: Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387954.422532:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787387954.422747:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945630336:0@lo:41: 00000020:00000004:2.0:1787387954.761623:0:10086:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787387954.761695:0:10086:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787387954.800204:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387955.150002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387955.150258:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925655680 00000100:00100000:2.0:1787387955.150268:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925655680 00000100:00100000:2.0:1787387955.150340:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 182 00000100:00100000:2.0:1787387955.150381:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1874211925655680:12345-192.168.203.15@tcp:250: 00010000:00080000:2.0:1787387955.150418:0:6514:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c26a556f-3215-464e-beb8-43d9848a19a5@192.168.203.15@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:2.0:1787387955.150448:0:6514:0:(genops.c:1406:class_connect()) connect: client c26a556f-3215-464e-beb8-43d9848a19a5, cookie 0x26817551a447442d 00000100:00080000:2.0:1787387955.150563:0:6514:0:(import.c:65:import_set_state_nolock()) ffff996a4339c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787387955.150629:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+5:2398:x1874211925655680:12345-192.168.203.15@tcp:250: Request processed in 249us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387955.150637:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 182 00000100:00100000:2.0:1787387955.161816:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387955.161913:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925655808 00000100:00100000:0.0:1787387955.161923:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925655808 00000100:00100000:0.0:1787387955.162020:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 183 00000100:00100000:0.0:1787387955.162033:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+5:6158:x1874211925655808:12345-192.168.203.15@tcp:101: 00010000:00010000:0.0:1787387955.162051:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387955.162067:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09e00/0x26817551a4474434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7c4a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387955.162092:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09e00/0x26817551a4474434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c4a expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387955.162103:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09e00/0x26817551a4474434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c4a expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387955.162111:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09e00, rc 0) 00000100:00100000:0.0:1787387955.162175:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+6:6158:x1874211925655808:12345-192.168.203.15@tcp:101: Request processed in 144us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387955.162182:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 183 00000100:00100000:0.0:1787387955.168217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387955.168376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925655936 00000100:00100000:2.0:1787387955.168385:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925655936 00000100:00100000:2.0:1787387955.168448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 184 00000100:00100000:2.0:1787387955.168459:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+6:6158:x1874211925655936:12345-192.168.203.15@tcp:501: 00000100:00100000:2.0:1787387955.168572:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+6:6158:x1874211925655936:12345-192.168.203.15@tcp:501: Request processed in 115us (363us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387955.168592:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 184 00000100:00100000:2.0:1787387955.172662:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387955.172759:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925656064 00000100:00100000:0.0:1787387955.172780:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925656064 00000100:00100000:0.0:1787387955.172833:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 185 00000100:00100000:0.0:1787387955.172842:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+6:6158:x1874211925656064:12345-192.168.203.15@tcp:101: 00010000:00010000:0.0:1787387955.172857:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387955.172873:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e08600/0x26817551a447443b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7c51 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387955.172898:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e08600/0x26817551a447443b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c51 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387955.172909:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e08600/0x26817551a447443b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c51 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387955.172918:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08600, rc 0) 00000100:00100000:0.0:1787387955.172983:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+7:6158:x1874211925656064:12345-192.168.203.15@tcp:101: Request processed in 141us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387955.172990:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 185 00000100:00100000:0.0:1787387955.179984:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387955.180076:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925656192 00000100:00100000:3.0:1787387955.180093:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925656192 00000100:00100000:3.0:1787387955.180286:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 186 00000100:00100000:3.0:1787387955.180299:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+7:6158:x1874211925656192:12345-192.168.203.15@tcp:501: 00000100:00100000:2.0:1787387955.181291:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+8:6158:x1874211925656192:12345-192.168.203.15@tcp:501: Request processed in 988us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387955.181303:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 186 00000100:00100000:3.0:1787387955.189482:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387955.189749:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925656320 00000100:00100000:2.0:1787387955.189762:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925656320 00000100:00100000:2.0:1787387955.189829:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 187 00000100:00100000:2.0:1787387955.189841:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+8:6158:x1874211925656320:12345-192.168.203.15@tcp:503: 00000100:00100000:2.0:1787387955.190062:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+8:6158:x1874211925656320:12345-192.168.203.15@tcp:503: Request processed in 222us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387955.190071:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 187 00000100:00100000:3.0:1787387955.196750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387955.197093:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925656448 00000100:00100000:2.0:1787387955.197107:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925656448 00000100:00100000:2.0:1787387955.197513:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 188 00000100:00100000:2.0:1787387955.197529:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+8:6177:x1874211925656448:12345-192.168.203.15@tcp:502: 00000100:00100000:2.0:1787387955.198342:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+8:6177:x1874211925656448:12345-192.168.203.15@tcp:502: Request processed in 811us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387955.198378:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 188 00000100:00100000:1.0:1787387955.229215:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387955.232653:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925656576 00000100:00100000:0.0:1787387955.232676:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925656576 00000100:00100000:0.0:1787387955.232761:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 189 00000100:00100000:0.0:1787387955.232773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+8:6177:x1874211925656576:12345-192.168.203.15@tcp:502: 00000100:00100000:0.0:1787387955.233252:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+8:6177:x1874211925656576:12345-192.168.203.15@tcp:502: Request processed in 474us (4046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387955.233263:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 189 00000100:00100000:0.0:1787387955.251131:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387955.251312:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925656704 00000100:00100000:2.0:1787387955.251326:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925656704 00000100:00100000:2.0:1787387955.251439:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 190 00000100:00100000:2.0:1787387955.251452:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+8:6158:x1874211925656704:12345-192.168.203.15@tcp:101: 00010000:00010000:2.0:1787387955.251475:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387955.251497:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e5e00/0x26817551a4474442 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7c82 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387955.251554:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e5e00/0x26817551a4474442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c82 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387955.251567:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e5e00/0x26817551a4474442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c82 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387955.251578:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e5e00, rc 0) 00000100:00100000:2.0:1787387955.251653:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+9:6158:x1874211925656704:12345-192.168.203.15@tcp:101: Request processed in 204us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387955.251661:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 190 00000100:00100000:3.0:1787387955.256023:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387955.256129:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925656832 00000100:00100000:0.0:1787387955.256142:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925656832 00000100:00100000:0.0:1787387955.256229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 191 00000100:00100000:0.0:1787387955.256240:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+9:6158:x1874211925656832:12345-192.168.203.15@tcp:256: 20000000:01000000:0.0:1787387955.256273:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787387955.256293:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787387955.256298:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787387955.256301:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787387955.256303:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787387955.256305:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787387955.261498:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+9:6158:x1874211925656832:12345-192.168.203.15@tcp:256: Request processed in 5241us (5471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387955.261516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 191 00000100:00100000:1.0:1787387955.267255:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387955.267453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925656960 00000100:00100000:3.0:1787387955.267467:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925656960 00000100:00100000:3.0:1787387955.267609:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 192 00000100:00100000:3.0:1787387955.267622:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+9:6158:x1874211925656960:12345-192.168.203.15@tcp:101: 00010000:00010000:3.0:1787387955.267646:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387955.267668:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b414a2400/0x26817551a4474449 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7c89 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387955.267720:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b414a2400/0x26817551a4474449 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c89 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387955.267744:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b414a2400/0x26817551a4474449 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c89 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387955.267755:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b414a2400, rc 0) 00000100:00100000:3.0:1787387955.267832:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6158:x1874211925656960:12345-192.168.203.15@tcp:101: Request processed in 214us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387955.267841:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 192 00000100:00100000:3.0:1787387955.270530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387955.272047:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925657088 00000100:00100000:0.0:1787387955.272063:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925657088 00000100:00100000:0.0:1787387955.272193:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 193 00000100:00100000:0.0:1787387955.272206:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:6158:x1874211925657088:12345-192.168.203.15@tcp:501: 00000100:00100000:0.0:1787387955.272457:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:6158:x1874211925657088:12345-192.168.203.15@tcp:501: Request processed in 253us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387955.272466:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 193 00000100:00100000:1.0:1787387955.275772:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387955.275829:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925657216 00000100:00100000:3.0:1787387955.275843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925657216 00000100:00100000:3.0:1787387955.276256:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 194 00000100:00100000:3.0:1787387955.276269:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6158:x1874211925657216:12345-192.168.203.15@tcp:503: 00000100:00100000:0.0:1787387955.276747:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6158:x1874211925657216:12345-192.168.203.15@tcp:503: Request processed in 476us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387955.276757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 194 00000100:00100000:1.0:1787387955.283858:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387955.284691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925657344 00000100:00100000:0.0:1787387955.284708:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925657344 00000100:00100000:0.0:1787387955.284784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 195 00000100:00100000:0.0:1787387955.284796:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:6183:x1874211925657344:12345-192.168.203.15@tcp:502: 00000100:00100000:0.0:1787387955.285015:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:6183:x1874211925657344:12345-192.168.203.15@tcp:502: Request processed in 220us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387955.285034:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 195 00000100:00100000:3.0:1787387955.289708:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387955.290511:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925657472 00000100:00100000:0.0:1787387955.290525:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925657472 00000100:00100000:0.0:1787387955.290671:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 196 00000100:00100000:0.0:1787387955.290686:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6183:x1874211925657472:12345-192.168.203.15@tcp:502: 00000100:00100000:0.0:1787387955.290888:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6183:x1874211925657472:12345-192.168.203.15@tcp:502: Request processed in 205us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387955.290897:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 196 00000100:00100000:1.0:1787387955.299055:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387955.299104:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387955.299460:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925657600 00000100:00100000:0.0:1787387955.299487:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925657600 00000100:00100000:0.0:1787387955.299544:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925657856 00000100:00100000:0.0:1787387955.299548:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925657856 00000100:00100000:0.0:1787387955.299566:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1787387955.299577:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874211925657600:12345-192.168.203.15@tcp:38: 00010000:00080000:0.0:1787387955.299629:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:0.0:1787387955.299703:0:6520:0:(genops.c:1406:class_connect()) connect: client 00e97fed-41ea-4716-be07-f037d23906cf, cookie 0x26817551a4474450 00000004:00100000:0.0:1787387955.299735:0:6520:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787387955.301302:0:6520:0:(import.c:65:import_set_state_nolock()) ffff996a420ca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387955.301436:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2398:x1874211925657600:12345-192.168.203.15@tcp:38: Request processed in 1858us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387955.301448:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1787387955.301488:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:0.0:1787387955.301496:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874211925657856:12345-192.168.203.15@tcp:38: 00010000:00080000:0.0:1787387955.301523:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:0.0:1787387955.301704:0:6520:0:(genops.c:1406:class_connect()) connect: client 00e97fed-41ea-4716-be07-f037d23906cf, cookie 0x26817551a4474457 00000004:00100000:0.0:1787387955.301747:0:6520:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787387955.302440:0:6520:0:(import.c:65:import_set_state_nolock()) ffff996a4310b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787387955.302540:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2398:x1874211925657856:12345-192.168.203.15@tcp:38: Request processed in 1033us (3425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387955.302549:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:1.0:1787387955.437113:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945630464:0@lo:13: 00000100:00100000:1.0:1787387955.437239:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387955.437459:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945630464 00000100:00100000:2.0:1787387955.437470:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945630464 00000100:00080000:0.0:1787387955.437512:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387955.437551:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787387955.437553:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387955.437568:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945630464:12345-0@lo:13: 00000100:00100000:0.0:1787387955.437575:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945630592:0@lo:13: 00002000:00000024:2.0:1787387955.437614:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387955.437654:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387955.437745:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787387955.437755:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1787387955.437866:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945630848:0@lo:400: 00000100:00100000:1.0:1787387955.437874:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945631104:0@lo:400: 00000100:00100000:2.0:1787387955.437988:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945630464:12345-0@lo:13: Request processed in 425us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387955.437996:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787387955.438018:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945630592 00000100:00100000:2.0:1787387955.438023:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945630592 00000100:00100000:2.0:1787387955.438052:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787387955.438058:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945630592:12345-0@lo:13: 00002000:00000024:2.0:1787387955.438069:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387955.438097:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945630592:12345-0@lo:13: Request processed in 39us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387955.438103:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787387955.438492:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387955.438510:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945630976:0@lo:400: 00000100:00100000:2.0:1787387955.438543:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387955.438639:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945631488:0@lo:400: 00000100:00100000:2.0:1787387955.438666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387955.438685:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945632000:0@lo:400: 00000100:00100000:2.0:1787387955.438705:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787387955.438741:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43379500 x1874211945630464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387955.438753:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787387955.438779:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945630464:0@lo:13: 00000100:00100000:2.0:1787387955.438807:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945631488 00000100:00100000:2.0:1787387955.438810:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945631488 00000100:00100000:2.0:1787387955.438857:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945632000 00000100:00100000:2.0:1787387955.438861:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945632000 00000100:00100000:2.0:1787387955.438938:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787387955.439028:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945631488:12345-0@lo:400: 00000100:00100000:2.0:1787387955.439076:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945631488:12345-0@lo:400: Request processed in 131us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387955.439083:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787387955.439096:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787387955.439103:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945632000:12345-0@lo:400: 00000100:00100000:2.0:1787387955.439132:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945632000:12345-0@lo:400: Request processed in 29us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387955.439138:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787387955.439153:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787387955.439182:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43806d80 x1874211945631488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387955.439193:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945631488:0@lo:400: 00010000:00080000:2.0:1787387955.439203:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43807100 x1874211945632000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387955.439210:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945632000:0@lo:400: 00000100:00100000:2.0:1787387955.439265:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945630976 00000100:00100000:2.0:1787387955.439270:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945630976 00000100:00100000:2.0:1787387955.439300:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787387955.439306:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945630976:12345-0@lo:400: 00000100:00100000:2.0:1787387955.439400:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945630976:12345-0@lo:400: Request processed in 40us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387955.439408:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787387955.439438:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945630976:0@lo:400: 00010000:00080000:0.0:1787387955.442150:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c57480 x1874211945630592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387955.442167:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787387955.442196:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945630592:0@lo:13: 00000100:00100000:0.0:1787387955.442223:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945630720:0@lo:400: 00000100:00100000:0.0:1787387955.444134:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387955.444200:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945631232:0@lo:400: 00000100:00100000:0.0:1787387955.444229:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387955.444310:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945631744:0@lo:400: 00000100:00100000:2.0:1787387955.444587:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945630720 00000100:00100000:2.0:1787387955.444596:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945630720 00000100:00100000:2.0:1787387955.444658:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787387955.444668:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945630720:12345-0@lo:400: 00000100:00100000:3.0:1787387955.448129:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387955.448189:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945631360:0@lo:400: 00000100:00100000:3.0:1787387955.448230:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387955.448248:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945631872:0@lo:400: 00000100:00100000:3.0:1787387955.448272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387955.448502:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945630848 00000100:00100000:3.0:1787387955.449622:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945630848 00000100:00100000:3.0:1787387955.449675:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945631360 00000100:00100000:3.0:1787387955.449679:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945631360 00000100:00100000:3.0:1787387955.449713:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945631872 00000100:00100000:3.0:1787387955.449716:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945631872 00000100:00100000:3.0:1787387955.449735:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787387955.449743:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945630848:12345-0@lo:400: 00000100:00100000:3.0:1787387955.449818:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945630848:12345-0@lo:400: Request processed in 76us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387955.449825:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787387955.449843:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787387955.449848:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945631360:12345-0@lo:400: 00000100:00100000:3.0:1787387955.449877:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945631360:12345-0@lo:400: Request processed in 28us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387955.449883:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787387955.449893:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787387955.449898:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945631872:12345-0@lo:400: 00000100:00100000:3.0:1787387955.449925:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945631872:12345-0@lo:400: Request processed in 26us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387955.449930:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787387955.449961:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787387955.450001:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43805f80 x1874211945630848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387955.450015:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945630848:0@lo:400: 00010000:00080000:3.0:1787387955.450030:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43806680 x1874211945631360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387955.450039:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945631360:0@lo:400: 00010000:00080000:3.0:1787387955.450064:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43807800 x1874211945631872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387955.450072:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945631872:0@lo:400: 00000100:00100000:3.0:1787387955.450147:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945631232 00000100:00100000:3.0:1787387955.450152:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945631232 00000100:00100000:3.0:1787387955.450182:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787387955.450190:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945631232:12345-0@lo:400: 00000100:00100000:3.0:1787387955.450229:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945631232:12345-0@lo:400: Request processed in 40us (5998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387955.450235:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787387955.452380:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387955.452449:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945631616:0@lo:400: 00000100:00100000:1.0:1787387955.452507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387955.452616:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945631616 00000100:00100000:1.0:1787387955.452626:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945631616 00000100:00100000:3.0:1787387955.453548:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945631104 00000100:00100000:3.0:1787387955.453566:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945631104 00000100:00100000:3.0:1787387955.453629:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787387955.453639:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945631104:12345-0@lo:400: 00000100:00100000:3.0:1787387955.453730:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945631104:12345-0@lo:400: Request processed in 93us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387955.453737:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787387955.453904:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43806300 x1874211945631104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387955.453920:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945631104:0@lo:400: 00000100:00100000:1.0:1787387955.454243:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787387955.454258:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945631616:12345-0@lo:400: 00000100:00100000:1.0:1787387955.454337:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945631616:12345-0@lo:400: Request processed in 84us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387955.454343:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787387955.454398:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43805c00 x1874211945631616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387955.454409:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945631616:0@lo:400: 00000100:00100000:0.0:1787387955.454614:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387955.454665:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945631232:0@lo:400: 00000100:00080000:3.0:1787387955.454748:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387955.454826:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945631744 00000100:00100000:1.0:1787387955.454835:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945631744 00000100:00100000:2.0:1787387955.454894:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945630720:12345-0@lo:400: Request processed in 10222us (10760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387955.454895:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787387955.454912:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787387955.454976:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945631744:12345-0@lo:400: 00000100:00080000:3.0:1787387955.455024:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387955.455053:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945631744:12345-0@lo:400: Request processed in 144us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387955.455063:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787387955.455083:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945630720:0@lo:400: 00010000:00080000:0.0:1787387955.455105:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43807b80 x1874211945631744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387955.455114:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945631744:0@lo:400: 00010000:00010000:0.0:1787387955.820637:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387956.316825:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387956.316891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387956.317164:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925658112 00000100:00100000:2.0:1787387956.317178:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925658112 00000100:00080000:0.0:1787387956.317298:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387956.317460:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925657984 00000100:00100000:2.0:1787387956.317466:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925657984 00000100:00100000:2.0:1787387956.317509:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:2.0:1787387956.317522:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:6158:x1874211925658112:12345-192.168.203.15@tcp:41: 00000004:00000024:2.0:1787387956.317591:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787387956.317687:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:6158:x1874211925658112:12345-192.168.203.15@tcp:41: Request processed in 159us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.317697:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:2.0:1787387956.317718:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:2.0:1787387956.317725:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:0:x1874211925657984:12345-192.168.203.15@tcp:41: 00000004:00000024:2.0:1787387956.317743:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787387956.317767:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:0:x1874211925657984:12345-192.168.203.15@tcp:41: Request processed in 43us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.317773:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00080000:0.0:1787387956.317866:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787387956.318408:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387956.318901:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925657728 00000100:00100000:3.0:1787387956.318910:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925657728 00000100:00100000:3.0:1787387956.318960:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:3.0:1787387956.318969:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:0:x1874211925657728:12345-192.168.203.15@tcp:41: 00000004:00000024:3.0:1787387956.319004:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787387956.319059:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:0:x1874211925657728:12345-192.168.203.15@tcp:41: Request processed in 91us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.319071:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:3.0:1787387956.321907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387956.321997:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925658240 00000100:00100000:0.0:1787387956.322010:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925658240 00000100:00100000:0.0:1787387956.322077:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:0.0:1787387956.322090:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:6158:x1874211925658240:12345-192.168.203.15@tcp:40: 00000100:00100000:0.0:1787387956.325737:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:6158:x1874211925658240:12345-192.168.203.15@tcp:40: Request processed in 3631us (3824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387956.325757:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:3.0:1787387956.333688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387956.333790:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387956.333843:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387956.333901:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925658368 00000100:00100000:3.0:1787387956.333914:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925658368 00000100:00100000:3.0:1787387956.333973:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925658496 00000100:00100000:3.0:1787387956.333976:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925658496 00000100:00100000:3.0:1787387956.333997:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1787387956.334007:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1874211925658368:12345-192.168.203.15@tcp:8: 00010000:00080000:3.0:1787387956.334059:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:3.0:1787387956.334114:0:8436:0:(genops.c:1406:class_connect()) connect: client 00e97fed-41ea-4716-be07-f037d23906cf, cookie 0x26817551a447445e 00002000:00100000:3.0:1787387956.334130:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 00e97fed-41ea-4716-be07-f037d23906cf/ffff996a42d86800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787387956.334165:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787387956.334490:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787387956.334529:0:8436:0:(import.c:65:import_set_state_nolock()) ffff996a42d83800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787387956.334627:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2398:x1874211925658368:12345-192.168.203.15@tcp:8: Request processed in 620us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.334636:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1787387956.334660:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:3.0:1787387956.334666:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1874211925658496:12345-192.168.203.15@tcp:8: 00010000:00080000:3.0:1787387956.334685:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:3.0:1787387956.334709:0:8436:0:(genops.c:1406:class_connect()) connect: client 00e97fed-41ea-4716-be07-f037d23906cf, cookie 0x26817551a4474465 00002000:00100000:3.0:1787387956.334716:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 00e97fed-41ea-4716-be07-f037d23906cf/ffff996a42d84800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787387956.334723:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787387956.334854:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787387956.334871:0:8436:0:(import.c:65:import_set_state_nolock()) ffff996a42d86000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787387956.334898:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2398:x1874211925658496:12345-192.168.203.15@tcp:8: Request processed in 231us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.334905:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1787387956.336836:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925658624 00000100:00100000:0.0:1787387956.336855:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925658624 00000100:00100000:0.0:1787387956.336939:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 198 00000100:00100000:0.0:1787387956.336961:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925658624:12345-192.168.203.15@tcp:400: 00000100:00100000:0.0:1787387956.337039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925658624:12345-192.168.203.15@tcp:400: Request processed in 81us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387956.337047:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 198 00000100:00100000:1.0:1787387956.340435:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387956.340564:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925658752 00000100:00100000:3.0:1787387956.340579:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925658752 00000100:00100000:3.0:1787387956.340639:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:3.0:1787387956.340650:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:00e97fed-41ea-4716-be07-f037d23906cf+6:6158:x1874211925658752:12345-192.168.203.15@tcp:900: 00000100:00100000:3.0:1787387956.340762:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:00e97fed-41ea-4716-be07-f037d23906cf+6:6158:x1874211925658752:12345-192.168.203.15@tcp:900: Request processed in 113us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.340771:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:1.0:1787387956.343455:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387956.343738:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925658880 00000100:00100000:0.0:1787387956.343752:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925658880 00000100:00100000:0.0:1787387956.343820:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1787387956.343833:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:6158:x1874211925658880:12345-192.168.203.15@tcp:33: 00000004:00080000:0.0:1787387956.363329:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 19359us 00000004:00200000:3.0:1787387956.377915:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787387956.378038:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:6158:x1874211925658880:12345-192.168.203.15@tcp:33: Request processed in 34203us (34592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387956.378065:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:1.0:1787387956.460853:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945632128:0@lo:41: 00000100:00100000:1.0:1787387956.460922:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387956.461049:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945632128 00000100:00100000:0.0:1787387956.461058:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945632128 00000100:00100000:0.0:1787387956.461110:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787387956.461119:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945632128:12345-0@lo:41: 00000004:00000024:0.0:1787387956.461161:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787387956.465727:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945632128:12345-0@lo:41: Request processed in 4599us (4795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387956.465743:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787387956.473373:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945632128:0@lo:41: 00000100:00100000:1.0:1787387956.609294:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387956.609511:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925659008 00000100:00100000:2.0:1787387956.609520:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925659008 00000100:00100000:2.0:1787387956.609581:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:2.0:1787387956.609591:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:6202:x1874211925659008:12345-192.168.203.15@tcp:101: 00010000:00010000:2.0:1787387956.609612:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387956.609692:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447446c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7cba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387956.609756:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a4474473 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387956.609770:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a4474473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387956.609784:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a4474473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787387956.609831:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787387956.609847:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787387956.609865:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a4474473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387956.609893:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447446c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cba expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387956.609912:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a4474473 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cba expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387956.609921:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b4555d800) 00010000:00010000:2.0:1787387956.610059:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787387956.610064:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4000, rc 0) 00000100:00100000:2.0:1787387956.610127:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+7:6202:x1874211925659008:12345-192.168.203.15@tcp:101: Request processed in 537us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387956.610134:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00010000:00010000:0.0:1787387956.845223:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387957.484569:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387957.484603:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945632256:0@lo:13: 00000100:00100000:3.0:1787387957.484691:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387957.484839:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945632256 00000100:00100000:2.0:1787387957.484852:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945632256 00000100:00100000:2.0:1787387957.484920:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787387957.484932:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945632256:12345-0@lo:13: 00000100:00100000:1.0:1787387957.484963:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945632384:0@lo:13: 00002000:00000024:2.0:1787387957.484990:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387957.485008:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387957.485052:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945632256:12345-0@lo:13: Request processed in 122us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387957.485060:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787387957.485076:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945632384 00000100:00100000:2.0:1787387957.485080:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945632384 00000100:00100000:2.0:1787387957.485100:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787387957.485106:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945632384:12345-0@lo:13: 00002000:00000024:2.0:1787387957.485116:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787387957.485184:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787387957.485215:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43807800 x1874211945632256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387957.485235:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945632256:0@lo:13: 00000100:00100000:2.0:1787387957.486033:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945632384:12345-0@lo:13: Request processed in 922us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387957.486043:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787387957.486295:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c55180 x1874211945632384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387957.486310:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945632384:0@lo:13: 00010000:00010000:0.0:1787387957.868572:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387958.708833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387958.709227:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925659136 00000100:00100000:0.0:1787387958.709242:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925659136 00000100:00100000:0.0:1787387958.709339:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1787387958.709401:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:6254:x1874211925659136:12345-192.168.203.15@tcp:41: 00000004:00000024:0.0:1787387958.709441:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787387958.709517:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:6254:x1874211925659136:12345-192.168.203.15@tcp:41: Request processed in 169us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387958.709525:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00080000:3.0:1787387958.709916:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387958.714393:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387958.714498:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925659264 00000100:00100000:2.0:1787387958.714508:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925659264 00000100:00100000:2.0:1787387958.714587:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:2.0:1787387958.714598:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:6254:x1874211925659264:12345-192.168.203.15@tcp:41: 00000004:00000024:2.0:1787387958.714636:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787387958.714705:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:6254:x1874211925659264:12345-192.168.203.15@tcp:41: Request processed in 109us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387958.714713:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00080000:3.0:1787387958.715259:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787387958.718247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387958.718479:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925659392 00000100:00100000:3.0:1787387958.718491:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925659392 00000100:00100000:3.0:1787387958.718661:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1787387958.718673:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00e97fed-41ea-4716-be07-f037d23906cf+6:6254:x1874211925659392:12345-192.168.203.15@tcp:13: 00002000:00000024:3.0:1787387958.718714:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387958.718886:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00e97fed-41ea-4716-be07-f037d23906cf+6:6254:x1874211925659392:12345-192.168.203.15@tcp:13: Request processed in 215us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387958.718896:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00080000:0.0:1787387958.718993:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387958.720911:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387958.721015:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925659520 00000100:00100000:2.0:1787387958.721026:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925659520 00000100:00100000:2.0:1787387958.721111:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:2.0:1787387958.721125:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00e97fed-41ea-4716-be07-f037d23906cf+6:6254:x1874211925659520:12345-192.168.203.15@tcp:13: 00002000:00000024:2.0:1787387958.721160:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387958.721236:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00e97fed-41ea-4716-be07-f037d23906cf+6:6254:x1874211925659520:12345-192.168.203.15@tcp:13: Request processed in 114us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387958.721244:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00080000:0.0:1787387958.721672:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787387958.893180:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387959.532781:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945632512:0@lo:41: 00000100:00100000:2.0:1787387959.532875:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387959.533193:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945632512 00000100:00100000:0.0:1787387959.533204:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945632512 00000100:00100000:0.0:1787387959.533265:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787387959.533275:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945632512:12345-0@lo:41: 00000004:00000024:0.0:1787387959.533321:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787387959.534253:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945632512:12345-0@lo:41: Request processed in 972us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387959.534265:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787387959.534605:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945632512:0@lo:41: 00010000:00010000:0.0:1787387959.917528:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387960.556505:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387960.556532:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945632768:0@lo:400: 00000100:00100000:0.0:1787387960.556619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387960.556660:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945632640:0@lo:13: 00000100:00100000:0.0:1787387960.556685:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387960.556709:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945633280:0@lo:400: 00000100:00100000:3.0:1787387960.556724:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945632640 00000100:00100000:3.0:1787387960.556732:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945632640 00000100:00100000:0.0:1787387960.556744:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387960.556766:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945633792:0@lo:400: 00000100:00100000:0.0:1787387960.556797:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387960.556815:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787387960.556824:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945634304:0@lo:400: 00000100:00100000:3.0:1787387960.556829:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945632640:12345-0@lo:13: 00002000:00000024:3.0:1787387960.556859:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387960.556869:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387960.556907:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945632640:12345-0@lo:13: Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387960.556924:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787387960.557043:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c56a00 x1874211945632640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387960.557061:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945632640:0@lo:13: 00000100:00100000:0.0:1787387960.557077:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787387960.557082:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945633152:0@lo:400: 00000100:00100000:0.0:1787387960.557104:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387960.557120:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945633664:0@lo:400: 00000100:00100000:0.0:1787387960.557135:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387960.557269:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945633024:0@lo:400: 00000100:00100000:2.0:1787387960.557297:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387960.557313:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945633536:0@lo:400: 00000100:00100000:2.0:1787387960.557340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387960.557367:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945634048:0@lo:400: 00000100:00100000:2.0:1787387960.557383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387960.557409:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787387960.557414:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945632896:0@lo:400: 00000100:00100000:2.0:1787387960.557431:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387960.557440:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945633408:0@lo:400: 00000100:00100000:2.0:1787387960.557453:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387960.557460:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945633920:0@lo:400: 00000100:00100000:2.0:1787387960.557476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387960.557495:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945632768 00000100:00100000:2.0:1787387960.557499:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945632768 00000100:00100000:2.0:1787387960.557526:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787387960.557532:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945632768:12345-0@lo:400: 00000100:00100000:2.0:1787387960.557561:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945632768:12345-0@lo:400: Request processed in 29us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387960.557567:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787387960.557617:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945633280 00000100:00100000:2.0:1787387960.557620:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945633280 00000100:00100000:2.0:1787387960.557635:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945633024 00000100:00100000:2.0:1787387960.557637:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945633024 00000100:00100000:2.0:1787387960.557648:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787387960.557653:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945633280:12345-0@lo:400: 00000100:00100000:2.0:1787387960.557679:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945633280:12345-0@lo:400: Request processed in 26us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387960.557684:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787387960.557695:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787387960.557705:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945633024:12345-0@lo:400: 00000100:00100000:2.0:1787387960.557730:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945633024:12345-0@lo:400: Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387960.557735:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787387960.557751:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945633152 00000100:00100000:2.0:1787387960.557754:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945633152 00000100:00100000:2.0:1787387960.557767:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945633536 00000100:00100000:2.0:1787387960.557769:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945633536 00000100:00100000:2.0:1787387960.557778:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945634048 00000100:00100000:2.0:1787387960.557780:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945634048 00000100:00100000:2.0:1787387960.557789:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945632896 00000100:00100000:2.0:1787387960.557790:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945632896 00000100:00100000:2.0:1787387960.557800:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945633408 00000100:00100000:2.0:1787387960.557801:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945633408 00000100:00100000:2.0:1787387960.557812:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945633920 00000100:00100000:2.0:1787387960.557815:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945633920 00000100:00100000:2.0:1787387960.557826:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787387960.557843:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945633152:12345-0@lo:400: 00000100:00100000:2.0:1787387960.557876:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945633152:12345-0@lo:400: Request processed in 25us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387960.557882:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787387960.557892:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787387960.557898:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945633536:12345-0@lo:400: 00000100:00100000:2.0:1787387960.557934:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945633536:12345-0@lo:400: Request processed in 37us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387960.557940:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787387960.557950:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787387960.557956:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945634048:12345-0@lo:400: 00000100:00100000:2.0:1787387960.557975:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945634048:12345-0@lo:400: Request processed in 21us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387960.557985:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787387960.557995:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787387960.558001:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945632896:12345-0@lo:400: 00000100:00080000:3.0:1787387960.558016:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387960.558023:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787387960.558026:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387960.558027:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945632896:12345-0@lo:400: Request processed in 26us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387960.558034:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787387960.558043:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787387960.558048:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945633408:12345-0@lo:400: 00000100:00100000:2.0:1787387960.558065:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945633408:12345-0@lo:400: Request processed in 17us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387960.558070:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787387960.558077:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787387960.558082:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945633920:12345-0@lo:400: 00000100:00100000:2.0:1787387960.558099:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945633920:12345-0@lo:400: Request processed in 17us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387960.558104:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787387960.558134:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945632896:0@lo:400: 00000100:00100000:2.0:1787387960.558143:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945633408:0@lo:400: 00000100:00100000:2.0:1787387960.558151:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945633920:0@lo:400: 00000100:00100000:2.0:1787387960.558158:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945633024:0@lo:400: 00010000:00080000:2.0:1787387960.558169:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f589180 x1874211945633536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387960.558178:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945633536:0@lo:400: 00010000:00080000:2.0:1787387960.558192:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f588700 x1874211945634048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387960.558200:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945634048:0@lo:400: 00000100:00100000:2.0:1787387960.558220:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387960.558225:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945634432:0@lo:13: 00000100:00100000:2.0:1787387960.558245:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387960.560630:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945634176:0@lo:400: 00000100:00100000:0.0:1787387960.560686:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387960.566391:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945633280:0@lo:400: 00000100:00100000:3.0:1787387960.566828:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945633792 00000100:00100000:3.0:1787387960.566837:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945633792 00000100:00100000:3.0:1787387960.566897:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945634304 00000100:00100000:3.0:1787387960.566901:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945634304 00000100:00100000:3.0:1787387960.566928:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945633664 00000100:00100000:3.0:1787387960.566932:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945633664 00000100:00100000:3.0:1787387960.567167:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945634176 00000100:00100000:3.0:1787387960.567177:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945634176 00000100:00100000:3.0:1787387960.567199:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787387960.567208:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945633792:12345-0@lo:400: 00000100:00100000:3.0:1787387960.567281:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945633792:12345-0@lo:400: Request processed in 74us (10483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387960.567288:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787387960.567304:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787387960.567309:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945634304:12345-0@lo:400: 00000100:00100000:3.0:1787387960.567430:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945634304:12345-0@lo:400: Request processed in 120us (10561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387960.567436:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787387960.567449:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387960.567454:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945633664:12345-0@lo:400: 00000100:00100000:3.0:1787387960.567481:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945633664:12345-0@lo:400: Request processed in 26us (10344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387960.567486:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787387960.567497:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787387960.567503:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945634176:12345-0@lo:400: 00000100:00100000:3.0:1787387960.567527:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945634176:12345-0@lo:400: Request processed in 25us (6842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387960.567533:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787387960.567553:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945634432 00000100:00100000:3.0:1787387960.567557:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945634432 00000100:00100000:3.0:1787387960.567586:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787387960.567597:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945634432:12345-0@lo:13: 00010000:00080000:0.0:1787387960.567597:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f589500 x1874211945633792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387960.567615:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945633792:0@lo:400: 00002000:00000024:3.0:1787387960.567617:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1787387960.567630:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f588a80 x1874211945634304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387960.567650:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945634304:0@lo:400: 00000100:00100000:0.0:1787387960.567667:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945632768:0@lo:400: 00000100:00100000:3.0:1787387960.567674:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945634432:12345-0@lo:13: Request processed in 78us (9425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387960.567683:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787387960.567707:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945633152:0@lo:400: 00000100:00080000:3.0:1787387960.567709:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387960.567715:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787387960.567726:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f588e00 x1874211945633664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387960.567734:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945633664:0@lo:400: 00010000:00080000:0.0:1787387960.567746:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58a300 x1874211945634176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387960.567754:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945634176:0@lo:400: 00010000:00080000:3.0:1787387960.567810:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c0c9500 x1874211945634432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387960.567827:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945634432:0@lo:13: 00000001:00100000:2.0:1787387960.568123:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00010000:00010000:0.0:1787387960.941649:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787387961.304149:0:10185:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787387961.583455:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945634560:0@lo:41: 00000100:00100000:3.0:1787387961.583524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387961.583596:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945634560 00000100:00100000:2.0:1787387961.583604:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945634560 00000100:00100000:2.0:1787387961.583659:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787387961.583669:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945634560:12345-0@lo:41: 00000004:00000024:2.0:1787387961.583700:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787387961.583751:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945634560:12345-0@lo:41: Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387961.583759:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787387961.583866:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945634560:0@lo:41: 00000001:00100000:2.0:1787387961.584002:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000001:00100000:2.0:1787387961.584197:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000100:00100000:1.0:1787387961.604461:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387961.604635:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387961.604648:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925659776 00000100:00100000:2.0:1787387961.604659:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925659776 00000100:00100000:1.0:1787387961.604676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387961.604734:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387961.604756:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925659904 00000100:00100000:3.0:1787387961.604761:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925660032 00000100:00100000:2.0:1787387961.604762:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925659904 00000100:00100000:3.0:1787387961.604776:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925660032 00000100:00100000:1.0:1787387961.604787:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387961.604796:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1787387961.604810:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925659776:12345-192.168.203.15@tcp:400: 00000100:00100000:1.0:1787387961.604824:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787387961.604835:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787387961.604846:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925660160 00000100:00100000:3.0:1787387961.604852:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925660160 00000100:00100000:1.0:1787387961.604869:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:1.0:1787387961.604884:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925660032:12345-192.168.203.15@tcp:400: 00000100:00100000:2.0:1787387961.604901:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925659776:12345-192.168.203.15@tcp:400: Request processed in 94us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387961.604919:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1787387961.604933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:3.0:1787387961.604940:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925660160:12345-192.168.203.15@tcp:400: 00000100:00100000:2.0:1787387961.604992:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:2.0:1787387961.605006:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925659904:12345-192.168.203.15@tcp:400: 00000100:00100000:0.0:1787387961.605008:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925659648 00000100:00100000:0.0:1787387961.605017:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925659648 00000100:00100000:3.0:1787387961.605031:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925660160:12345-192.168.203.15@tcp:400: Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387961.605043:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1787387961.605057:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925659904:12345-192.168.203.15@tcp:400: Request processed in 53us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387961.605068:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 200 00000100:00100000:2.0:1787387961.605069:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:0.0:1787387961.605085:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925659648:12345-192.168.203.15@tcp:400: 00000100:00080000:3.0:1787387961.605094:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387961.605103:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387961.605107:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787387961.605111:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387961.605125:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925659648:12345-192.168.203.15@tcp:400: Request processed in 45us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387961.605134:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 200 00000100:00100000:1.0:1787387961.605233:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925660032:12345-192.168.203.15@tcp:400: Request processed in 354us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387961.605243:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00010000:00010000:0.0:1787387961.965371:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387962.606253:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945634688:0@lo:13: 00000100:00100000:3.0:1787387962.606317:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387962.606394:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945634688 00000100:00100000:3.0:1787387962.606406:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945634688 00000100:00100000:3.0:1787387962.606451:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787387962.606459:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945634688:12345-0@lo:13: 00002000:00000024:3.0:1787387962.606484:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387962.606524:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945634688:12345-0@lo:13: Request processed in 65us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387962.606530:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787387962.606550:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787387962.606576:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58ad80 x1874211945634688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387962.606593:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945634688:0@lo:13: 00000100:00100000:3.0:1787387962.609732:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945634816:0@lo:13: 00000100:00100000:3.0:1787387962.609791:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387962.609850:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945634816 00000100:00100000:3.0:1787387962.609856:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945634816 00000100:00100000:3.0:1787387962.609895:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387962.609914:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945634816:12345-0@lo:13: 00002000:00000024:3.0:1787387962.609933:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387962.609968:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945634816:12345-0@lo:13: Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387962.609974:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787387962.609991:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787387962.610014:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7389dc00 x1874211945634816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387962.610030:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945634816:0@lo:13: 00000001:00100000:0.0:1787387962.621992:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00010000:00010000:0.0:1787387962.992222:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.012996:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387964.655235:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945634944:0@lo:41: 00000100:00100000:2.0:1787387964.655302:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.656537:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945634944 00000100:00100000:3.0:1787387964.656554:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945634944 00000100:00100000:3.0:1787387964.656621:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787387964.656631:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945634944:12345-0@lo:41: 00000004:00000024:3.0:1787387964.656666:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787387964.658656:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945634944:12345-0@lo:41: Request processed in 2018us (3344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.658669:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787387964.660490:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945634944:0@lo:41: 00000020:00000080:1.0:1787387964.765866:0:10333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd86d6f980 00000020:00000080:1.0:1787387964.765898:0:10333:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787387964.765903:0:10333:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787387964.765911:0:10333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd86d71c10 20000000:00000080:1.0:1787387964.765917:0:10333:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996a43218000 uarg=0000000000000000 20000000:01000000:1.0:1787387964.765956:0:10333:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787387964.765958:0:10333:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787387964.765961:0:10333:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787387964.765965:0:10333:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787387964.765970:0:10333:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787387964.766029:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787387964.766032:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787387964.769254:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1787387964.769725:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1787387964.769758:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1787387964.769773:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1787387964.769783:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787387964.769785:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787387964.779480:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1787387964.779957:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1787387964.779991:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1787387964.780008:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1787387964.780021:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787387964.780023:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787387964.782532:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1787387964.782775:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1787387964.782804:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1787387964.782816:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1787387964.782826:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787387964.782829:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787387964.783190:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1787387964.783589:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1787387964.783612:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1787387964.783626:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1787387964.783637:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787387964.783639:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787387964.787149:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1787387964.790785:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1787387964.790825:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1787387964.790842:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:1.0:1787387964.790858:0:10333:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787387964.790877:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790906:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b74e09200/0x26817551a4474315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447430e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790932:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b40030000/0x26817551a447433f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474338 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790939:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b40030400/0x26817551a447437e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474377 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790945:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b70076800/0x26817551a447438c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474385 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790952:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b413fea00/0x26817551a447439a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474393 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790959:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b413fe000/0x26817551a44743b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44743af expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790966:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a431e4c00/0x26817551a44743e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44743d9 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790973:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a431e4400/0x26817551a44743fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44743f5 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790979:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b414a2c00/0x26817551a4474426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447441f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790989:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b74e09e00/0x26817551a4474434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c4a expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.790998:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b74e08600/0x26817551a447443b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c51 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.791017:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.792173:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b74e08600/0x26817551a447443b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c51 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.792192:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b74e08600/0x26817551a447443b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c51 expref: 9 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.792209:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f590e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635072:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787387964.795549:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b74e09e00/0x26817551a4474434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c4a expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.795578:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b74e09e00/0x26817551a4474434 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c4a expref: 9 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.795595:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635200:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787387964.795635:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b414a2c00/0x26817551a4474426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a447441f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.795643:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b414a2c00/0x26817551a4474426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a447441f expref: 23 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.795652:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635328:0@lo:104: 00000100:00100000:0.0:1787387964.795690:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387964.795726:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a431e4400/0x26817551a44743fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44743f5 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.795735:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a431e4400/0x26817551a44743fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44743f5 expref: 23 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.795743:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635456:0@lo:104: 00000100:00100000:0.0:1787387964.795764:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387964.795792:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a431e4c00/0x26817551a44743e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44743d9 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.795800:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a431e4c00/0x26817551a44743e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44743d9 expref: 23 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.795808:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635584:0@lo:104: 00000100:00100000:0.0:1787387964.795829:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387964.795855:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b413fe000/0x26817551a44743b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44743af expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.795863:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b413fe000/0x26817551a44743b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44743af expref: 23 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.795870:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635712:0@lo:104: 00000100:00100000:0.0:1787387964.795905:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387964.795922:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b413fea00/0x26817551a447439a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474393 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.795929:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b413fea00/0x26817551a447439a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474393 expref: 23 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.795938:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635840:0@lo:104: 00010000:00010000:0.0:1787387964.795961:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b70076800/0x26817551a447438c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474385 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.795969:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b70076800/0x26817551a447438c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474385 expref: 23 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.795976:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635968:0@lo:104: 00010000:00010000:0.0:1787387964.795998:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b40030400/0x26817551a447437e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474377 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.796004:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b40030400/0x26817551a447437e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474377 expref: 23 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.796012:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945636096:0@lo:104: 00000100:00100000:3.0:1787387964.796380:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787387964.796400:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.796411:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.796419:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387964.796427:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945635328 00000100:00100000:3.0:1787387964.796434:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945635328 00000100:00100000:3.0:1787387964.796467:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945635456 00000100:00100000:3.0:1787387964.796470:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945635456 00000100:00100000:3.0:1787387964.796481:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945635584 00000100:00100000:3.0:1787387964.796484:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945635584 00000100:00100000:3.0:1787387964.796492:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945635712 00000100:00100000:3.0:1787387964.796494:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945635712 00000100:00100000:3.0:1787387964.796503:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945635840 00000100:00100000:3.0:1787387964.796506:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945635840 00000100:00100000:3.0:1787387964.796523:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945635968 00000100:00100000:3.0:1787387964.796526:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945635968 00000100:00100000:3.0:1787387964.796534:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945636096 00000100:00100000:3.0:1787387964.796537:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945636096 00000100:00100000:3.0:1787387964.796551:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787387964.796558:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+9:10333:x1874211945635328:12345-0@lo:104: 00010000:00010000:3.0:1787387964.796570:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.796621:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387964.796627:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+9:10333:x1874211945635328:12345-0@lo:104: Request processed in 69us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.796634:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787387964.796650:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387964.796656:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+8:10333:x1874211945635456:12345-0@lo:104: 00010000:00010000:3.0:1787387964.796663:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.796696:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787387964.796701:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+8:10333:x1874211945635456:12345-0@lo:104: Request processed in 46us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.796707:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787387964.796719:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787387964.796724:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+7:10333:x1874211945635584:12345-0@lo:104: 00010000:00010000:3.0:1787387964.796731:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.796755:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787387964.796766:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+7:10333:x1874211945635584:12345-0@lo:104: Request processed in 42us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.796772:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787387964.796784:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787387964.796790:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+6:10333:x1874211945635712:12345-0@lo:104: 00010000:00010000:3.0:1787387964.796797:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.796823:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787387964.796827:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+6:10333:x1874211945635712:12345-0@lo:104: Request processed in 39us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.796832:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787387964.796863:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387964.796869:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+5:10333:x1874211945635840:12345-0@lo:104: 00010000:00010000:3.0:1787387964.796876:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.796911:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787387964.796915:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+5:10333:x1874211945635840:12345-0@lo:104: Request processed in 47us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.796921:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387964.796931:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787387964.796937:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+4:10333:x1874211945635968:12345-0@lo:104: 00010000:00010000:3.0:1787387964.796943:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.796964:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787387964.796975:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+4:10333:x1874211945635968:12345-0@lo:104: Request processed in 38us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.796980:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787387964.796991:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787387964.796997:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:10333:x1874211945636096:12345-0@lo:104: 00010000:00010000:3.0:1787387964.797004:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.797029:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787387964.797033:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:10333:x1874211945636096:12345-0@lo:104: Request processed in 37us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.797039:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787387964.797167:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787387964.797174:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797180:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b414a3c00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787387964.797184:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797192:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387964.797199:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387964.797205:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387964.797241:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797247:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387964.797271:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797278:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b414a3c00/0x26817551a447441f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474426 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797293:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787387964.797296:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797302:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b414a3400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787387964.797305:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797311:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387964.797317:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387964.797322:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387964.797335:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797340:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387964.797367:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797374:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b414a3400/0x26817551a44743f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44743fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797382:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787387964.797390:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797396:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b413fec00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787387964.797399:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797405:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387964.797411:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387964.797416:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387964.797429:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797434:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387964.797439:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797446:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b413fec00/0x26817551a44743d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44743e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797455:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787387964.797458:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797462:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b413fe400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787387964.797465:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797480:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387964.797485:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387964.797490:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387964.797501:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797506:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387964.797511:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797517:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b413fe400/0x26817551a44743af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44743b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797524:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787387964.797526:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797530:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787387964.797532:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797537:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387964.797543:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387964.797553:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387964.797564:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797569:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387964.797573:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797579:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a4474393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447439a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797587:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787387964.797590:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797595:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b413fee00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787387964.797597:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797603:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387964.797609:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387964.797614:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387964.797626:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797631:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387964.797645:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797650:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b413fee00/0x26817551a4474385 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447438c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797659:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387964.797661:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797666:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b413fe600 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787387964.797669:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797675:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387964.797680:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387964.797685:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787387964.797710:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797716:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387964.797720:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797726:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b413fe600/0x26817551a4474377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447437e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.797735:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387964.797742:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387964.797744:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387964.797760:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945636224:0@lo:103: 00000100:00100000:1.0:1787387964.797799:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.797830:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945636736:0@lo:103: 00000100:00100000:1.0:1787387964.797850:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.797870:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387964.797876:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945636608:0@lo:103: 00000100:00100000:1.0:1787387964.797905:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.797929:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945636352:0@lo:103: 00000100:00100000:1.0:1787387964.797947:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.797960:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945636864:0@lo:103: 00000100:00100000:1.0:1787387964.797975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.797983:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787387964.797987:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945636480:0@lo:103: 00000100:00100000:1.0:1787387964.798001:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.798008:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945636992:0@lo:103: 00000100:00100000:1.0:1787387964.798021:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387964.798041:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945636224 00000100:00100000:1.0:1787387964.798133:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945636224 00010000:00010000:1.0:1787387964.798159:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b414a2c00/0x26817551a4474426 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447441f expref: 24 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.798175:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945636736 00000100:00100000:1.0:1787387964.798178:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945636736 00010000:00010000:1.0:1787387964.798189:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b413fea00/0x26817551a447439a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474393 expref: 25 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.798211:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945636608 00000100:00100000:1.0:1787387964.798214:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945636608 00010000:00010000:1.0:1787387964.798226:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b413fe000/0x26817551a44743b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44743af expref: 26 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.798235:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945636352 00000100:00100000:1.0:1787387964.798237:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945636352 00010000:00010000:1.0:1787387964.798246:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a431e4400/0x26817551a44743fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44743f5 expref: 27 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.798253:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945636864 00000100:00100000:1.0:1787387964.798255:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945636864 00010000:00010000:1.0:1787387964.798263:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b70076800/0x26817551a447438c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474385 expref: 28 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.798271:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945636480 00000100:00100000:1.0:1787387964.798273:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945636480 00010000:00010000:1.0:1787387964.798280:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a431e4c00/0x26817551a44743e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44743d9 expref: 29 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.798288:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945636992 00000100:00100000:1.0:1787387964.798289:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945636992 00010000:00010000:1.0:1787387964.798297:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b40030400/0x26817551a447437e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474377 expref: 30 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387964.798307:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787387964.798314:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+30:3652:x1874211945636224:12345-0@lo:103: 00010000:00010000:1.0:1787387964.798324:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387964.798329:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b414a2c00/0x26817551a4474426 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447441f expref: 30 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798370:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b414a2c00/0x26817551a4474426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a447441f expref: 30 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798389:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387964.798423:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+30:3652:x1874211945636224:12345-0@lo:103: Request processed in 109us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.798431:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787387964.798473:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787387964.798480:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+29:3652:x1874211945636736:12345-0@lo:103: 00010000:00010000:1.0:1787387964.798486:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387964.798490:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b413fea00/0x26817551a447439a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474393 expref: 29 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798499:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b413fea00/0x26817551a447439a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474393 expref: 29 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798508:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387964.798528:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+29:3652:x1874211945636736:12345-0@lo:103: Request processed in 49us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.798534:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787387964.798545:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787387964.798551:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+28:3652:x1874211945636608:12345-0@lo:103: 00010000:00010000:1.0:1787387964.798557:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387964.798561:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b413fe000/0x26817551a44743b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44743af expref: 28 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798569:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b413fe000/0x26817551a44743b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44743af expref: 28 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798586:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387964.798608:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+28:3652:x1874211945636608:12345-0@lo:103: Request processed in 58us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.798614:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787387964.798626:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387964.798631:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+27:3649:x1874211945636352:12345-0@lo:103: 00010000:00010000:1.0:1787387964.798639:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387964.798642:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a431e4400/0x26817551a44743fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44743f5 expref: 27 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798650:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a431e4400/0x26817551a44743fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44743f5 expref: 27 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798659:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387964.798683:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+27:3649:x1874211945636352:12345-0@lo:103: Request processed in 52us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.798689:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787387964.798701:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787387964.798706:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+26:3649:x1874211945636864:12345-0@lo:103: 00010000:00010000:1.0:1787387964.798713:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387964.798717:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b70076800/0x26817551a447438c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474385 expref: 26 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798726:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b70076800/0x26817551a447438c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474385 expref: 26 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798735:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387964.798761:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+26:3649:x1874211945636864:12345-0@lo:103: Request processed in 55us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.798768:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787387964.798779:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387964.798785:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+25:3649:x1874211945636480:12345-0@lo:103: 00010000:00010000:1.0:1787387964.798792:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387964.798796:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a431e4c00/0x26817551a44743e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44743d9 expref: 25 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798804:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a431e4c00/0x26817551a44743e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44743d9 expref: 25 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798813:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387964.798831:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+25:3649:x1874211945636480:12345-0@lo:103: Request processed in 46us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.798837:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787387964.798848:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787387964.798854:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945636992:12345-0@lo:103: 00010000:00010000:1.0:1787387964.798860:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387964.798864:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b40030400/0x26817551a447437e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474377 expref: 24 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798871:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b40030400/0x26817551a447437e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474377 expref: 24 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.798880:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387964.798911:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945636992:12345-0@lo:103: Request processed in 58us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.798917:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787387964.798970:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945636480:0@lo:103: 00000100:00100000:1.0:1787387964.798979:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945636992:0@lo:103: 00000100:00100000:1.0:1787387964.798985:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945636352:0@lo:103: 00000100:00100000:1.0:1787387964.798991:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945636864:0@lo:103: 00000100:00100000:1.0:1787387964.799019:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945636608:0@lo:103: 00000100:00100000:1.0:1787387964.799025:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945636224:0@lo:103: 00000100:00100000:1.0:1787387964.799031:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945636736:0@lo:103: 00010000:00010000:3.0:1787387964.799235:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387964.799552:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b40030000/0x26817551a447433f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474338 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.799571:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b40030000/0x26817551a447433f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474338 expref: 23 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.799584:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945637120:0@lo:104: 00000100:00100000:0.0:1787387964.799618:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387964.799659:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b74e09200/0x26817551a4474315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a447430e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.799667:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b74e09200/0x26817551a4474315 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a447430e expref: 23 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.799674:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945637248:0@lo:104: 00000100:00100000:0.0:1787387964.799695:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.799719:0:10333:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a423650c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787387964.799734:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b414a2c00/0x26817551a4474426 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a447441f expref: 23 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.799745:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635328:0@lo:104: 00010000:00010000:0.0:1787387964.799755:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e4400/0x26817551a44743fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44743f5 expref: 22 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.799762:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635456:0@lo:104: 00010000:00010000:0.0:1787387964.799771:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e4c00/0x26817551a44743e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44743d9 expref: 21 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.799779:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635584:0@lo:104: 00010000:00010000:0.0:1787387964.799787:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b413fe000/0x26817551a44743b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44743af expref: 20 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.799804:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635712:0@lo:104: 00010000:00010000:0.0:1787387964.799815:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b413fea00/0x26817551a447439a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474393 expref: 19 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.799822:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635840:0@lo:104: 00010000:00010000:0.0:1787387964.799829:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70076800/0x26817551a447438c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474385 expref: 18 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.799836:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635968:0@lo:104: 00010000:00010000:0.0:1787387964.799844:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40030400/0x26817551a447437e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474377 expref: 17 pid: 6515 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.799851:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945636096:0@lo:104: 00000100:00100000:2.0:1787387964.799911:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945637120 00000100:00100000:2.0:1787387964.799916:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945637120 00000100:00100000:2.0:1787387964.799943:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945637248 00000100:00100000:2.0:1787387964.799946:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945637248 00000100:00100000:2.0:1787387964.799958:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787387964.799964:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:10333:x1874211945637120:12345-0@lo:104: 00010000:00010000:2.0:1787387964.799975:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800028:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787387964.800034:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:10333:x1874211945637120:12345-0@lo:104: Request processed in 71us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.800040:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787387964.800068:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787387964.800074:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:10333:x1874211945637248:12345-0@lo:104: 00010000:00010000:2.0:1787387964.800081:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800125:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787387964.800131:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:10333:x1874211945637248:12345-0@lo:104: Request processed in 58us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387964.800136:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787387964.800152:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787387964.800157:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800164:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09000 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787387964.800168:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800176:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387964.800183:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387964.800189:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387964.800212:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800219:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387964.800231:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800237:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e09000/0x26817551a4474338 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447433f expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800259:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787387964.800263:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800268:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787387964.800270:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800277:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787387964.800282:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387964.800287:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787387964.800301:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800306:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787387964.800311:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800317:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e08200/0x26817551a447430e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474315 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387964.800329:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387964.800331:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387964.800332:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387964.800694:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945637376:0@lo:103: 00000100:00100000:1.0:1787387964.800730:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387964.800821:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945637120:0@lo:104: 00000100:00100000:0.0:1787387964.800830:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945637248:0@lo:104: 00000100:00100000:1.0:1787387964.800884:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387964.800900:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945637504:0@lo:103: 00000100:00100000:1.0:1787387964.800924:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787387964.804074:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387964.804825:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387964.805255:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945637376 00000100:00100000:3.0:1787387964.805264:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945637376 00010000:00010000:3.0:1787387964.805304:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b40030000/0x26817551a447433f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474338 expref: 17 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.805335:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945637504 00000100:00100000:3.0:1787387964.805339:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945637504 00010000:00010000:3.0:1787387964.805377:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b74e09200/0x26817551a4474315 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447430e expref: 18 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.805396:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787387964.805404:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:3651:x1874211945637376:12345-0@lo:103: 00010000:00010000:3.0:1787387964.805416:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387964.805421:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b40030000/0x26817551a447433f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474338 expref: 18 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.805431:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b40030000/0x26817551a447433f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474338 expref: 18 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.805459:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40030000/0x26817551a447433f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474338 expref: 18 pid: 6514 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.805474:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387964.805516:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:3651:x1874211945637376:12345-0@lo:103: Request processed in 113us (4786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.805523:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787387964.805563:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787387964.805570:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:3651:x1874211945637504:12345-0@lo:103: 00010000:00010000:3.0:1787387964.805577:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387964.805581:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b74e09200/0x26817551a4474315 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447430e expref: 16 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.805589:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b74e09200/0x26817551a4474315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a447430e expref: 16 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.805598:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09200/0x26817551a4474315 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a447430e expref: 16 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.805607:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387964.805629:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3651:x1874211945637504:12345-0@lo:103: Request processed in 59us (4703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.805634:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387964.809955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387964.809992:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925660288 00000100:00100000:1.0:1787387964.810002:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925660288 00010000:00010000:1.0:1787387964.810038:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b74e09e00/0x26817551a4474434 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c4a expref: 10 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.810407:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925660416 00000100:00100000:3.0:1787387964.810413:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925660416 00010000:00010000:3.0:1787387964.810432:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b74e08600/0x26817551a447443b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c51 expref: 11 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387964.810465:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:3.0:1787387964.810488:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f592300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+11:2402:x1874211925660416:12345-192.168.203.15@tcp:103: 00010000:00010000:3.0:1787387964.810502:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787387964.810507:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b74e08600/0x26817551a447443b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c51 expref: 11 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.810520:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b74e08600/0x26817551a447443b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c51 expref: 11 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387964.810540:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787387964.810597:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f592300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+11:2402:x1874211925660416:12345-192.168.203.15@tcp:103: Request processed in 110us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387964.810606:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:1.0:1787387964.810702:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:1.0:1787387964.810711:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925660288:12345-192.168.203.15@tcp:103: 00010000:00010000:1.0:1787387964.810720:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387964.810735:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b74e09e00/0x26817551a4474434 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c4a expref: 10 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810756:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b74e09e00/0x26817551a4474434 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c4a expref: 10 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810769:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810777:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810791:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810798:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810805:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810811:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810818:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787387964.810822:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810830:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810840:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387964.810862:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387964.810884:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925660288:12345-192.168.203.15@tcp:103: Request processed in 174us (6066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387964.810901:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:1.0:1787387964.810953:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945637504:0@lo:103: 00000100:00100000:1.0:1787387964.810964:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945637376:0@lo:103: 00010000:00010000:0.0:1787387964.812260:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e08600/0x26817551a447443b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c51 expref: 9 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.812278:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f590e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635072:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787387964.812290:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09e00/0x26817551a4474434 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c4a expref: 8 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387964.812299:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874211945635200:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787387964.812342:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.812378:0:10333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.812384:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387964.812390:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70077600/0x26817551a447447a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387965.048808:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387965.676523:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387965.676565:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945637632:0@lo:13: 00000100:00100000:2.0:1787387965.676635:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387965.676778:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387965.676789:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945637760:0@lo:13: 00000100:00100000:1.0:1787387965.676845:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945637888:0@lo:400: 00000100:00100000:1.0:1787387965.676893:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.676918:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945638016:0@lo:400: 00000100:00100000:1.0:1787387965.676944:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945638400:0@lo:400: 00000100:00100000:3.0:1787387965.676963:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387965.676974:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.676994:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945638528:0@lo:400: 00000100:00100000:1.0:1787387965.676999:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945638912:0@lo:400: 00000100:00100000:3.0:1787387965.677031:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387965.677036:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.677055:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945639040:0@lo:400: 00000100:00100000:3.0:1787387965.677090:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.677122:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945638016 00000100:00100000:3.0:1787387965.677129:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945638016 00000100:00100000:3.0:1787387965.677165:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945638528 00000100:00100000:3.0:1787387965.677167:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945638528 00000100:00100000:3.0:1787387965.677183:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945639040 00000100:00100000:3.0:1787387965.677186:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945639040 00000100:00100000:3.0:1787387965.677200:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787387965.677207:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945638016:12345-0@lo:400: 00000100:00100000:0.0:1787387965.677284:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945637632 00000100:00100000:0.0:1787387965.677289:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945637632 00000100:00100000:0.0:1787387965.677320:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387965.677326:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945637632:12345-0@lo:13: 00002000:00000024:0.0:1787387965.677366:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387965.688979:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945638016:12345-0@lo:400: Request processed in 11762us (12007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.689010:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787387965.689044:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787387965.689055:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945638528:12345-0@lo:400: 00000100:00100000:3.0:1787387965.689124:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945638528:12345-0@lo:400: Request processed in 74us (12094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.689130:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787387965.689139:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787387965.689145:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945639040:12345-0@lo:400: 00000100:00100000:3.0:1787387965.689165:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945639040:12345-0@lo:400: Request processed in 21us (12075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.689170:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787387965.689203:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945638912 00000100:00100000:3.0:1787387965.689211:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945638912 00000100:00100000:3.0:1787387965.689264:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787387965.689271:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945638912:12345-0@lo:400: 00000100:00100000:3.0:1787387965.689303:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945638912:12345-0@lo:400: Request processed in 34us (12270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.689309:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787387965.689329:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387965.689333:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787387965.689336:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387965.689555:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945638016:0@lo:400: 00000100:00100000:3.0:1787387965.689567:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945638528:0@lo:400: 00000100:00100000:3.0:1787387965.689577:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945639040:0@lo:400: 00000100:00100000:3.0:1787387965.689633:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945637888 00000100:00100000:3.0:1787387965.689644:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945637888 00000100:00100000:3.0:1787387965.689672:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787387965.689679:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3651:x1874211945637888:12345-0@lo:400: 00000100:00100000:3.0:1787387965.689714:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+15:3651:x1874211945637888:12345-0@lo:400: Request processed in 36us (12820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.689720:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787387965.689782:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.689817:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945638144:0@lo:400: 00000100:00100000:3.0:1787387965.689846:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.689864:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945638656:0@lo:400: 00000100:00100000:3.0:1787387965.689897:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.689913:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945639168:0@lo:400: 00000100:00100000:3.0:1787387965.689936:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.689951:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787387965.689957:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945638272:0@lo:400: 00000100:00100000:3.0:1787387965.689975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.689990:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945638784:0@lo:400: 00000100:00100000:3.0:1787387965.690012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.690029:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945639296:0@lo:400: 00000100:00100000:3.0:1787387965.690050:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387965.690081:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945637760 00000100:00100000:3.0:1787387965.690085:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945637760 00000100:00100000:3.0:1787387965.690115:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787387965.690121:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945637760:12345-0@lo:13: 00002000:00000024:3.0:1787387965.690136:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387965.690170:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945637760:12345-0@lo:13: Request processed in 49us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.690183:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787387965.690210:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945638400 00000100:00100000:3.0:1787387965.690214:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945638400 00000100:00100000:3.0:1787387965.690233:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945638144 00000100:00100000:3.0:1787387965.690235:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945638144 00000100:00100000:3.0:1787387965.690249:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787387965.690254:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945638400:12345-0@lo:400: 00000100:00100000:3.0:1787387965.690288:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945638400:12345-0@lo:400: Request processed in 34us (13314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.690295:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787387965.690309:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787387965.690314:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945638144:12345-0@lo:400: 00000100:00100000:3.0:1787387965.690380:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945638144:12345-0@lo:400: Request processed in 65us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.690386:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787387965.691035:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945638784 00000100:00100000:1.0:1787387965.691041:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945638784 00000100:00100000:3.0:1787387965.693588:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945638656 00000100:00100000:3.0:1787387965.693601:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945638656 00000100:00100000:3.0:1787387965.693658:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945639168 00000100:00100000:3.0:1787387965.693662:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945639168 00000100:00100000:3.0:1787387965.693680:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945638272 00000100:00100000:3.0:1787387965.693682:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945638272 00000100:00100000:3.0:1787387965.693698:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787387965.693707:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945638656:12345-0@lo:400: 00000100:00100000:3.0:1787387965.693796:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945638656:12345-0@lo:400: Request processed in 88us (3896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.693803:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787387965.693818:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787387965.693823:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945639168:12345-0@lo:400: 00000100:00100000:3.0:1787387965.693870:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945639168:12345-0@lo:400: Request processed in 46us (3932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.693876:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787387965.693900:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787387965.693907:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945638272:12345-0@lo:400: 00000100:00100000:3.0:1787387965.693935:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945638272:12345-0@lo:400: Request processed in 29us (3959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.693940:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787387965.693964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787387965.693968:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787387965.694000:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945638272:0@lo:400: 00000100:00100000:3.0:1787387965.694015:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945638144:0@lo:400: 00010000:00080000:3.0:1787387965.694027:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f588a80 x1874211945638656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387965.694037:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945638656:0@lo:400: 00010000:00080000:3.0:1787387965.694046:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f589f80 x1874211945639168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387965.694055:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945639168:0@lo:400: 00010000:00080000:3.0:1787387965.694067:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f592680 x1874211945637760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387965.694080:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945637760:0@lo:13: 00000100:00100000:3.0:1787387965.694137:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945639296 00000100:00100000:3.0:1787387965.694140:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945639296 00000100:00100000:3.0:1787387965.694165:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787387965.694176:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3649:x1874211945639296:12345-0@lo:400: 00000100:00100000:3.0:1787387965.694212:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3649:x1874211945639296:12345-0@lo:400: Request processed in 36us (4162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387965.694218:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787387965.694245:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f588000 x1874211945639296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387965.694254:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945639296:0@lo:400: 00000100:00100000:1.0:1787387965.695246:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787387965.695255:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945638784:12345-0@lo:400: 00000100:00100000:1.0:1787387965.695309:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945638784:12345-0@lo:400: Request processed in 56us (5296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387965.695315:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787387965.695338:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787387965.695376:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f589500 x1874211945638784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387965.695405:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945638784:0@lo:400: 00010000:00080000:1.0:1787387965.695442:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f588700 x1874211945638912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387965.695451:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945638912:0@lo:400: 00000100:00100000:1.0:1787387965.695461:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945639424:0@lo:400: 00000100:00100000:1.0:1787387965.695492:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387965.695517:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945639424 00000100:00100000:1.0:1787387965.695521:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945639424 00000100:00100000:1.0:1787387965.695544:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787387965.695550:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945639424:12345-0@lo:400: 00000100:00100000:1.0:1787387965.695578:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945639424:12345-0@lo:400: Request processed in 28us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387965.695583:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787387965.695608:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c109180 x1874211945639424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387965.695617:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945639424:0@lo:400: 00000100:00100000:1.0:1787387965.695628:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945637888:0@lo:400: 00000100:00100000:1.0:1787387965.695650:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945638400:0@lo:400: 00000100:00100000:0.0:1787387965.696399:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945637632:12345-0@lo:13: Request processed in 19070us (19760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387965.696408:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787387965.696498:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58e300 x1874211945637632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387965.696514:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945637632:0@lo:13: 00010000:00010000:0.0:1787387966.060693:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787387966.316454:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787387966.316462:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b7f53f000 from 48 10000000:01000000:2.0:1787387966.316467:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787387966.316514:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.316524:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.316534:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387966.316554:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945639552:0@lo:101: 00000100:00100000:2.0:1787387966.316616:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387966.316687:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.320395:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945639552 00000100:00100000:0.0:1787387966.320420:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945639552 00000100:00100000:0.0:1787387966.320513:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787387966.320526:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+15:6518:x1874211945639552:12345-0@lo:101: 00010000:00010000:0.0:1787387966.320548:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387966.320575:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09e00/0x26817551a4474488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474481 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.320612:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09e00/0x26817551a4474488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474481 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.320644:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09e00/0x26817551a4474488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474481 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.320654:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09e00, rc 0) 00000100:00100000:0.0:1787387966.320776:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945639552:12345-0@lo:101: Request processed in 253us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.320784:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787387966.320938:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945639552:0@lo:101: 00010000:00010000:2.0:1787387966.320961:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.320971:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387966.321138:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945639680:0@lo:501: 00000100:00100000:2.0:1787387966.321196:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387966.321254:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.321326:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945639680 00000100:00100000:0.0:1787387966.321331:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945639680 00000100:00100000:0.0:1787387966.321403:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787387966.321412:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945639680:12345-0@lo:501: 00000100:00100000:0.0:1787387966.321574:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945639680:12345-0@lo:501: Request processed in 162us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.321582:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787387966.323420:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945639680:0@lo:501: 00000100:00100000:2.0:1787387966.323525:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945639808:0@lo:503: 00000100:00100000:2.0:1787387966.323618:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387966.323671:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.323751:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945639808 00000100:00100000:0.0:1787387966.323758:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945639808 00000100:00100000:0.0:1787387966.323819:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787387966.323830:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945639808:12345-0@lo:503: 00000100:00100000:0.0:1787387966.324040:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945639808:12345-0@lo:503: Request processed in 211us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.324048:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787387966.327275:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945639808:0@lo:503: 00000100:00100000:0.0:1787387966.328378:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10350:1874211945639936:0@lo:502: 00000100:00100000:0.0:1787387966.328489:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.328600:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b44e98480 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.330325:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945639936 00000100:00100000:3.0:1787387966.330358:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945639936 00000100:00100000:3.0:1787387966.330448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787387966.330460:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:10350:x1874211945639936:12345-0@lo:502: 00000100:00100000:3.0:1787387966.331323:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+16:10350:x1874211945639936:12345-0@lo:502: Request processed in 861us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.331335:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787387966.335617:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10350:1874211945639936:0@lo:502: 00000100:00100000:0.0:1787387966.336191:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10350:1874211945640064:0@lo:502: 00000100:00100000:0.0:1787387966.336307:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.336486:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b738c8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.339844:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945640064 00000100:00100000:1.0:1787387966.339865:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945640064 00000100:00100000:1.0:1787387966.340215:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787387966.340229:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:10350:x1874211945640064:12345-0@lo:502: 00000100:00100000:1.0:1787387966.340522:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+16:10350:x1874211945640064:12345-0@lo:502: Request processed in 294us (4212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.340543:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787387966.340685:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10350:1874211945640064:0@lo:502: 00000040:00080000:2.0:1787387966.340738:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787387966.343784:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787387966.343836:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787387966.343853:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.343867:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787387966.343890:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787387966.343895:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787387966.343898:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787387966.343965:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.343996:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.344019:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387966.344050:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945640192:0@lo:101: 00000100:00100000:3.0:1787387966.344152:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387966.348555:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42e080c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.348692:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945640192 00000100:00100000:0.0:1787387966.348706:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945640192 00000100:00100000:0.0:1787387966.348782:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787387966.348793:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+16:6518:x1874211945640192:12345-0@lo:101: 00010000:00010000:0.0:1787387966.348999:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387966.349147:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e08600/0x26817551a4474496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447448f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.349187:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e08600/0x26817551a4474496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447448f expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.349201:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e08600/0x26817551a4474496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447448f expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.349212:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08600, rc 0) 00000100:00100000:0.0:1787387966.349378:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945640192:12345-0@lo:101: Request processed in 586us (5226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.349386:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787387966.354988:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945640192:0@lo:101: 00010000:00010000:3.0:1787387966.355339:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.355368:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387966.355488:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945640320:0@lo:501: 00000100:00100000:3.0:1787387966.355573:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387966.355627:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42e080c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.355864:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945640320 00000100:00100000:0.0:1787387966.355874:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945640320 00000100:00100000:0.0:1787387966.355950:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787387966.355961:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945640320:12345-0@lo:501: 00000100:00100000:0.0:1787387966.356405:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945640320:12345-0@lo:501: Request processed in 444us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.356414:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787387966.356569:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945640320:0@lo:501: 00000100:00100000:3.0:1787387966.356613:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945640448:0@lo:503: 00000100:00100000:3.0:1787387966.356995:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387966.357206:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42e080c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.362090:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945640448 00000100:00100000:0.0:1787387966.362136:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945640448 00000100:00100000:1.0:1787387966.362435:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787387966.362452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945640448:12345-0@lo:503: 00000100:00100000:1.0:1787387966.362686:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945640448:12345-0@lo:503: Request processed in 239us (5752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.362696:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787387966.362810:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945640448:0@lo:503: 00000100:00100000:0.0:1787387966.363119:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10351:1874211945640576:0@lo:502: 00000100:00100000:0.0:1787387966.363175:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.363393:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72bc8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.363561:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945640576 00000100:00100000:3.0:1787387966.363567:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945640576 00000100:00100000:3.0:1787387966.363625:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787387966.363640:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:10351:x1874211945640576:12345-0@lo:502: 00000100:00100000:3.0:1787387966.363768:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:10351:x1874211945640576:12345-0@lo:502: Request processed in 128us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.363776:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787387966.363859:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10351:1874211945640576:0@lo:502: 00000020:01000000:0.0:1787387966.363901:0:10351:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387966.363914:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387966.363917:0:10351:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787387966.363923:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787387966.363949:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10351:1874211945640704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387966.363985:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.364006:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.364200:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945640704 00000100:00100000:3.0:1787387966.364205:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945640704 00000100:00100000:3.0:1787387966.364225:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787387966.364231:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:10351:x1874211945640704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387966.364303:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:10351:x1874211945640704:12345-0@lo:502:llog_process_th.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.364311:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787387966.364477:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10351:1874211945640704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387966.364497:0:10351:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387966.364502:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387966.364505:0:10351:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787387966.364509:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1787387966.364588:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787387966.364613:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787387966.364626:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.364640:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387966.364651:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787387966.364654:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b74ea1800 from 48 10000000:01000000:0.0:1787387966.364664:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787387966.364697:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.364707:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.364717:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387966.364732:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945640832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.364764:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.364787:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.364924:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945640832 00000100:00100000:3.0:1787387966.364929:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945640832 00000100:00100000:3.0:1787387966.364951:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787387966.364958:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+17:6518:x1874211945640832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387966.364968:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387966.364983:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b414a3000/0x26817551a44744a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447449d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.365007:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b414a3000/0x26817551a44744a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447449d expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.365019:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b414a3000/0x26817551a44744a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447449d expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.365142:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b414a3000, rc 0) 00000100:00100000:0.0:1787387966.365217:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945640832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387966.365231:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.365242:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387966.365297:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945640960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.365323:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.365332:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.365431:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945640832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.365451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787387966.365478:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945640960 00000100:00100000:3.0:1787387966.365482:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945640960 00000100:00100000:3.0:1787387966.365496:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787387966.365501:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945640960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387966.365626:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945640960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.365632:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787387966.365703:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945640960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.365727:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945641088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.365764:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.365787:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.365841:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945641088 00000100:00100000:3.0:1787387966.365845:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945641088 00000100:00100000:3.0:1787387966.365860:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787387966.365866:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945641088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387966.365953:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945641088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.365960:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787387966.366043:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945641088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387966.366576:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10352:1874211945641216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387966.366633:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.366806:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945641216 00000100:00100000:1.0:1787387966.366895:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945641216 00000100:00100000:1.0:1787387966.367147:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787387966.367160:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:10352:x1874211945641216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.367302:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:10352:x1874211945641216:12345-0@lo:502:llog_process_th.0 Request processed in 144us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.367310:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787387966.367452:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387966.367475:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10352:1874211945641216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387966.367532:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10352:1874211945641344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387966.367571:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387966.367590:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.367640:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945641344 00000100:00100000:1.0:1787387966.367645:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945641344 00000100:00100000:1.0:1787387966.367742:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787387966.367751:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:10352:x1874211945641344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.368185:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+18:10352:x1874211945641344:12345-0@lo:502:llog_process_th.0 Request processed in 433us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.368193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787387966.368258:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10352:1874211945641344:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787387966.368281:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787387966.368566:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787387966.368592:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387966.368605:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.368617:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387966.368637:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787387966.368640:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787387966.368644:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787387966.368913:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.368923:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.368934:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387966.369151:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f590380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945641472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.369214:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.369299:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a423659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387966.369450:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945641472 00000100:00100000:2.0:1787387966.369458:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945641472 00000100:00100000:2.0:1787387966.369556:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787387966.369567:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+18:6518:x1874211945641472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387966.369582:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387966.369607:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e4400/0x26817551a44744b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44744ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.369637:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e4400/0x26817551a44744b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44744ab expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.369650:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e4400/0x26817551a44744b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44744ab expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.369672:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4400, rc 0) 00000100:00100000:2.0:1787387966.369723:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945641472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387966.369730:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787387966.369804:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f590380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945641472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387966.369830:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.369840:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387966.369921:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f590380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945641600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.369963:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.370431:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a423659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.370484:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945641600 00000100:00100000:3.0:1787387966.370489:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945641600 00000100:00100000:3.0:1787387966.370519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787387966.370526:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945641600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387966.370683:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945641600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.370691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787387966.370716:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f590380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945641600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.370759:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945641728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.370809:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.370837:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.370903:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945641728 00000100:00100000:3.0:1787387966.370908:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945641728 00000100:00100000:3.0:1787387966.370947:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787387966.370953:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945641728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387966.371232:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945641728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.371240:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787387966.371390:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945641728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387966.371794:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10353:1874211945641856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387966.371853:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387966.371899:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42207000 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.372178:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945641856 00000100:00100000:0.0:1787387966.372186:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945641856 00000100:00100000:0.0:1787387966.372225:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787387966.372235:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:10353:x1874211945641856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387966.372390:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:10353:x1874211945641856:12345-0@lo:502:llog_process_th.0 Request processed in 156us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.372399:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787387966.372534:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10353:1874211945641856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387966.372563:0:10353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387966.372575:0:10353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387966.372578:0:10353:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787387966.372584:0:10353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787387966.372611:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10353:1874211945641984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387966.372652:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387966.372681:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42207000 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.372732:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945641984 00000100:00100000:0.0:1787387966.372737:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945641984 00000100:00100000:0.0:1787387966.372770:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787387966.372777:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:10353:x1874211945641984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387966.372866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:10353:x1874211945641984:12345-0@lo:502:llog_process_th.0 Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.372873:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787387966.373223:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10353:1874211945641984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387966.373244:0:10353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387966.373251:0:10353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387966.373253:0:10353:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787387966.373258:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1787387966.373530:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787387966.373559:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787387966.373572:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.373600:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387966.373612:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787387966.373616:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b73aa7800 from 48 10000000:01000000:0.0:1787387966.373619:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787387966.373651:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.373660:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.373671:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387966.373689:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945642112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.373732:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.373858:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72bc8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.374026:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945642112 00000100:00100000:1.0:1787387966.374032:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945642112 00000100:00100000:1.0:1787387966.374092:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787387966.374101:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+19:6518:x1874211945642112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387966.374113:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387966.374128:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70077600/0x26817551a44744c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44744b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.374155:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077600/0x26817551a44744c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44744b9 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.374167:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70077600/0x26817551a44744c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44744b9 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.374177:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077600, rc 0) 00000100:00100000:1.0:1787387966.374225:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945642112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.374232:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787387966.374400:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945642112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387966.374416:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.374426:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387966.374490:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945642240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.374520:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.374542:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72bc8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.374597:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945642240 00000100:00100000:1.0:1787387966.374602:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945642240 00000100:00100000:1.0:1787387966.374621:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787387966.374627:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945642240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.374808:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945642240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.374826:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787387966.375138:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945642240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.375168:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945642368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.375214:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.375244:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72bc8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.375286:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945642368 00000100:00100000:1.0:1787387966.375290:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945642368 00000100:00100000:1.0:1787387966.375323:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787387966.375330:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945642368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.375450:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945642368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.375465:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787387966.375612:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945642368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.376223:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10354:1874211945642496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387966.376277:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.376310:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72bc8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.376376:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945642496 00000100:00100000:1.0:1787387966.376383:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945642496 00000100:00100000:1.0:1787387966.376414:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787387966.376423:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:10354:x1874211945642496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.376522:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:10354:x1874211945642496:12345-0@lo:502:llog_process_th.0 Request processed in 99us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.376530:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787387966.376682:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10354:1874211945642496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387966.376724:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10354:1874211945642624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387966.376759:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.377013:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.377058:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945642624 00000100:00100000:1.0:1787387966.377062:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945642624 00000100:00100000:1.0:1787387966.377281:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787387966.377289:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:10354:x1874211945642624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.377399:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:10354:x1874211945642624:12345-0@lo:502:llog_process_th.0 Request processed in 110us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.377406:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787387966.377539:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10354:1874211945642624:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787387966.377563:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787387966.377733:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787387966.377756:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787387966.377767:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.377781:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387966.377794:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787387966.377797:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1787387966.377800:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787387966.377908:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.377926:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.377937:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387966.378020:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945642752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.378062:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.378267:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.378474:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945642752 00000100:00100000:3.0:1787387966.378481:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945642752 00000100:00100000:3.0:1787387966.378528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787387966.378537:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945642752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387966.378550:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387966.378566:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b414a2e00/0x26817551a44744ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44744c7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.378608:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b414a2e00/0x26817551a44744ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44744c7 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.378620:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b414a2e00/0x26817551a44744ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44744c7 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.378630:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b414a2e00, rc 0) 00000100:00100000:3.0:1787387966.378745:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945642752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.378753:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787387966.378887:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945642752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387966.378904:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.378915:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387966.379049:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945642880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.379152:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.379216:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365540 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.379279:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945642880 00000100:00100000:0.0:1787387966.379284:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945642880 00000100:00100000:2.0:1787387966.379333:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787387966.379428:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945642880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387966.379584:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945642880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387966.379591:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787387966.379669:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945642880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.379702:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945643008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.379750:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.379778:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365540 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.379834:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945643008 00000100:00100000:3.0:1787387966.379839:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945643008 00000100:00100000:3.0:1787387966.379870:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787387966.379888:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945643008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387966.380007:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945643008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.380014:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787387966.380263:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945643008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.381159:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10355:1874211945643136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.381226:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.381260:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365840 going to sleep for 11 seconds 00000100:00100000:3.0:1787387966.381394:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945643136 00000100:00100000:3.0:1787387966.381400:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945643136 00000100:00100000:3.0:1787387966.381430:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787387966.381438:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:10355:x1874211945643136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387966.381548:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:10355:x1874211945643136:12345-0@lo:502:llog_process_th.0 Request processed in 110us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.381555:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787387966.381723:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10355:1874211945643136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787387966.381750:0:10355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787387966.381761:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787387966.381764:0:10355:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787387966.381770:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787387966.381791:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10355:1874211945643264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.381902:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.381932:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365840 going to sleep for 11 seconds 00000100:00100000:2.0:1787387966.382136:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945643264 00000100:00100000:2.0:1787387966.382141:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945643264 00000100:00100000:2.0:1787387966.382179:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787387966.382187:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:10355:x1874211945643264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387966.382318:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:10355:x1874211945643264:12345-0@lo:502:llog_process_th.0 Request processed in 131us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387966.382324:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787387966.382545:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10355:1874211945643264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387966.382575:0:10355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387966.382581:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387966.382583:0:10355:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787387966.382588:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1787387966.382780:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1787387966.382806:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787387966.382893:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.382907:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387966.382919:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787387966.382922:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b46a34000 from 48 10000000:01000000:1.0:1787387966.382925:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787387966.383022:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.383032:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.383043:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387966.383140:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945643392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.383186:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.383258:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787387966.383303:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945643392 00000100:00100000:2.0:1787387966.383309:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945643392 00000100:00100000:2.0:1787387966.383588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787387966.383605:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945643392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387966.383618:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387966.383634:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e5800/0x26817551a44744dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44744d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.383661:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e5800/0x26817551a44744dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44744d5 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.383674:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e5800/0x26817551a44744dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44744d5 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.383685:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e5800, rc 0) 00000100:00100000:2.0:1787387966.383723:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945643392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387966.383730:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787387966.383801:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945643392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387966.383826:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.383837:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387966.383909:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945643520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.383947:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.384233:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.384307:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945643520 00000100:00100000:0.0:1787387966.384312:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945643520 00000100:00100000:0.0:1787387966.384340:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787387966.384378:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945643520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.384514:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945643520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.384521:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787387966.384606:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945643520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.384635:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945643648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.384679:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.384705:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.384782:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945643648 00000100:00100000:0.0:1787387966.384787:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945643648 00000100:00100000:0.0:1787387966.384804:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787387966.384821:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945643648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.384909:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945643648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.384916:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787387966.385100:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945643648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.385569:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10356:1874211945643776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.385619:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.385686:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365240 going to sleep for 11 seconds 00000100:00100000:2.0:1787387966.385755:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945643776 00000100:00100000:2.0:1787387966.385761:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945643776 00000100:00100000:3.0:1787387966.385946:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787387966.385958:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:10356:x1874211945643776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387966.386212:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:10356:x1874211945643776:12345-0@lo:502:llog_process_th.0 Request processed in 257us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.386221:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787387966.386304:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10356:1874211945643776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.386367:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10356:1874211945643904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.386412:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.386681:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365240 going to sleep for 11 seconds 00000100:00100000:0.0:1787387966.386723:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945643904 00000100:00100000:0.0:1787387966.386728:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945643904 00000100:00100000:0.0:1787387966.386756:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787387966.386764:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:10356:x1874211945643904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387966.386869:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:10356:x1874211945643904:12345-0@lo:502:llog_process_th.0 Request processed in 105us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.386886:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787387966.387087:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10356:1874211945643904:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787387966.387111:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787387966.387335:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787387966.387373:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787387966.387385:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.387398:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387966.387409:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787387966.387411:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1787387966.387414:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787387966.387445:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.387454:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.387473:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387966.387489:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945644032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.387530:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.387550:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.387608:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945644032 00000100:00100000:1.0:1787387966.387613:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945644032 00000100:00100000:1.0:1787387966.387633:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787387966.387639:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945644032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787387966.387649:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787387966.387662:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70077800/0x26817551a44744ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44744e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.387684:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077800/0x26817551a44744ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44744e3 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.387695:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70077800/0x26817551a44744ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44744e3 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.387704:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077800, rc 0) 00000100:00100000:1.0:1787387966.387730:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945644032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.387736:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787387966.387896:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945644032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387966.387910:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387966.387919:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387966.387977:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945644160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.388000:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.388018:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.388180:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945644160 00000100:00100000:1.0:1787387966.388184:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945644160 00000100:00100000:1.0:1787387966.388204:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787387966.388210:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945644160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.388323:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945644160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.388337:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787387966.388418:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945644160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.388446:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945644288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.388483:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.388504:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.388540:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945644288 00000100:00100000:1.0:1787387966.388545:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945644288 00000100:00100000:1.0:1787387966.388563:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787387966.388568:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945644288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.388650:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945644288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.388657:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787387966.388820:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945644288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387966.389298:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10357:1874211945644416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387966.389338:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.389395:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.389531:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945644416 00000100:00100000:1.0:1787387966.389537:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945644416 00000100:00100000:1.0:1787387966.389570:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787387966.389578:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:10357:x1874211945644416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.389678:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:10357:x1874211945644416:12345-0@lo:502:llog_process_th.0 Request processed in 101us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.389685:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787387966.389773:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10357:1874211945644416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387966.389796:0:10357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387966.389807:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387966.389819:0:10357:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787387966.389827:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787387966.389848:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10357:1874211945644544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387966.389894:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387966.389916:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387966.390270:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945644544 00000100:00100000:1.0:1787387966.390275:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945644544 00000100:00100000:1.0:1787387966.390311:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787387966.390318:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:10357:x1874211945644544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787387966.390737:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:10357:x1874211945644544:12345-0@lo:502:llog_process_th.0 Request processed in 418us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.390745:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787387966.390905:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10357:1874211945644544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387966.390932:0:10357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387966.391014:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387966.391017:0:10357:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787387966.391022:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787387966.391286:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1787387966.391314:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787387966.391328:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.391388:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387966.391401:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787387966.391404:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff996b72b819c0 from 1 10000000:01000000:1.0:1787387966.391407:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787387966.391447:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076e00/0x26817551a44744f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.391456:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b70076e00/0x26817551a44744f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387966.391466:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b70076e00/0x26817551a44744f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387966.391487:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945644672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787387966.391546:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387966.391571:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a423656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387966.391619:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945644672 00000100:00100000:2.0:1787387966.391625:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945644672 00000100:00100000:2.0:1787387966.391668:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787387966.391677:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945644672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387966.391690:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387966.391705:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e4600/0x26817551a44744f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44744f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.391732:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e4600/0x26817551a44744f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44744f1 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.391743:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e4600/0x26817551a44744f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44744f1 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387966.391761:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4600, rc 0) 00000100:00100000:2.0:1787387966.391810:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945644672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387966.391817:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787387966.391973:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945644672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387966.391988:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b70076e00/0x26817551a44744f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.391998:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b70076e00/0x26817551a44744f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387966.392062:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945644800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387966.392089:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387966.392122:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422079c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387966.392162:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945644800 00000100:00100000:2.0:1787387966.392167:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945644800 00000100:00100000:2.0:1787387966.392202:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787387966.392213:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945644800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387966.392403:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945644800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (312us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787387966.392410:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787387966.392790:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945644800:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787387966.392827:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787387966.392835:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076e00/0x26817551a44744f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387966.392844:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b70076e00/0x26817551a44744f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387966.701569:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387966.701608:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945644928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787387966.701701:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387966.701794:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945644928 00000100:00100000:2.0:1787387966.701805:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945644928 00000100:00100000:2.0:1787387966.701887:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787387966.701899:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945644928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787387966.701940:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787387966.702000:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945644928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387966.702008:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787387966.702063:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945644928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787387966.722802:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387966.722852:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387966.723016:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387966.723132:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925660928 00000100:00100000:2.0:1787387966.723144:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925660928 00000100:00100000:2.0:1787387966.723225:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1787387966.723239:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925660928:12345-192.168.203.15@tcp:400: 00000100:00100000:2.0:1787387966.723339:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925660928:12345-192.168.203.15@tcp:400: Request processed in 104us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387966.723406:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00080000:2.0:1787387966.723593:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387966.724602:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387966.724648:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387966.724686:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925661056 00000100:00100000:1.0:1787387966.724694:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925661056 00000100:00100000:1.0:1787387966.724753:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:1.0:1787387966.724763:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925661056:12345-192.168.203.15@tcp:400: 00000100:00100000:1.0:1787387966.724837:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925661056:12345-192.168.203.15@tcp:400: Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387966.724845:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:3.0:1787387966.725736:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925660672 00000100:00100000:3.0:1787387966.725745:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925660672 00000100:00100000:3.0:1787387966.725804:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925660800 00000100:00100000:3.0:1787387966.725808:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925660800 00000100:00100000:3.0:1787387966.725839:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:3.0:1787387966.725848:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2399:x1874211925660672:12345-192.168.203.15@tcp:400: 00000100:00100000:3.0:1787387966.725920:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2399:x1874211925660672:12345-192.168.203.15@tcp:400: Request processed in 72us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.725927:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:3.0:1787387966.725941:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:3.0:1787387966.725947:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925660800:12345-192.168.203.15@tcp:400: 00000100:00100000:3.0:1787387966.725973:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925660800:12345-192.168.203.15@tcp:400: Request processed in 26us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387966.725979:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00080000:2.0:1787387966.728840:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787387966.728853:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787387966.728867:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387966.733362:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925660544 00000100:00100000:0.0:1787387966.733384:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925660544 00000100:00100000:0.0:1787387966.733955:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 244 00000100:00100000:0.0:1787387966.733968:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+8:2399:x1874211925660544:12345-192.168.203.15@tcp:400: 00000100:00100000:0.0:1787387966.734075:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+8:2399:x1874211925660544:12345-192.168.203.15@tcp:400: Request processed in 109us (11059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387966.734083:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 244 00010000:00010000:0.0:1787387967.084658:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387967.724734:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945645056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787387967.724807:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387967.724897:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387967.724906:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945645184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387967.724929:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387967.725038:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945645056 00000100:00100000:3.0:1787387967.725052:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945645056 00000100:00100000:2.0:1787387967.725192:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945645184 00000100:00100000:2.0:1787387967.725201:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945645184 00000100:00100000:3.0:1787387967.725208:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787387967.725225:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945645056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787387967.725265:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387967.725401:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945645056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387967.725410:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787387967.725597:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787387967.725644:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7389c700 x1874211945645056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387967.725679:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945645056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787387967.735116:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787387967.735132:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945645184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387967.735161:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387967.735249:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945645184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (10317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387967.735256:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787387967.737491:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f571c00 x1874211945645184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387967.737518:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945645184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387968.113004:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387969.132637:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387969.773323:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387969.773784:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945645312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787387969.773965:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387969.774048:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945645312 00000100:00100000:2.0:1787387969.774063:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945645312 00000100:00100000:2.0:1787387969.774131:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787387969.774141:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945645312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787387969.774180:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787387969.774265:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945645312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387969.774272:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787387969.774504:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945645312:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787387970.156650:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387970.798198:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945645696:0@lo:400:kworker.0 00000100:00100000:2.0:1787387970.798273:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945645824:0@lo:400:kworker.0 00000100:00100000:3.0:1787387970.798291:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387970.798307:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387970.798398:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945645440:0@lo:400:kworker.0 00000100:00100000:1.0:1787387970.798483:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945645568:0@lo:400:kworker.0 00000100:00100000:2.0:1787387970.804220:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945646336:0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.804441:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387970.804486:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945645952:0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.804521:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387970.804544:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945646464:0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.804567:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387970.804586:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945646976:0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.804605:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387970.804677:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945645696 00000100:00100000:0.0:1787387970.804687:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945645696 00000100:00100000:0.0:1787387970.804735:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945645952 00000100:00100000:0.0:1787387970.804739:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945645952 00000100:00100000:0.0:1787387970.804758:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787387970.804768:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945645696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.804857:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945645696:12345-0@lo:400:kworker.0 Request processed in 90us (6565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.804865:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787387970.804888:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787387970.804894:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945645952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.804926:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945645952:12345-0@lo:400:kworker.0 Request processed in 32us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.804933:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787387970.804971:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945645952:0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.805332:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945646464 00000100:00100000:0.0:1787387970.805380:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945646464 00000100:00100000:0.0:1787387970.805430:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945646976 00000100:00100000:0.0:1787387970.805434:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945646976 00000100:00100000:0.0:1787387970.805456:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787387970.805463:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945646464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.805508:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945646464:12345-0@lo:400:kworker.0 Request processed in 46us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.805515:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787387970.805525:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787387970.805531:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945646976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.805562:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945646976:12345-0@lo:400:kworker.0 Request processed in 30us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.805568:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787387970.805603:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f571c00 x1874211945646464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387970.805616:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945646464:0@lo:400:kworker.0 00010000:00080000:0.0:1787387970.805626:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f588700 x1874211945646976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387970.805635:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945646976:0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.805658:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945645440 00000100:00100000:0.0:1787387970.805661:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945645440 00000100:00100000:0.0:1787387970.805692:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787387970.805698:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945645440:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787387970.805701:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387970.805706:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387970.805732:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945645440:12345-0@lo:400:kworker.0 Request processed in 35us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.805738:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387970.805738:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787387970.805774:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945646080:0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.805777:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945645440:0@lo:400:kworker.0 00000100:00100000:1.0:1787387970.805801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387970.805819:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945646592:0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.805855:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945645824 00000100:00100000:0.0:1787387970.805859:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945645824 00000100:00100000:1.0:1787387970.805869:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387970.805881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945645568 00000100:00100000:0.0:1787387970.805884:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945645568 00000100:00100000:1.0:1787387970.805890:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945646080 00000100:00100000:1.0:1787387970.805893:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945646080 00000100:00100000:0.0:1787387970.805894:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945646592 00000100:00100000:0.0:1787387970.805895:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945646592 00000100:00100000:0.0:1787387970.805910:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787387970.805920:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787387970.805927:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945645568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387970.805960:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945645568:12345-0@lo:400:kworker.0 Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.805966:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787387970.805977:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387970.805984:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945646592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387970.806008:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945646592:12345-0@lo:400:kworker.0 Request processed in 25us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.806015:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387970.806025:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787387970.806031:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945646080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387970.806056:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945646080:12345-0@lo:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.806062:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1787387970.806077:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387970.806093:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945646592:0@lo:400:kworker.0 00000100:00100000:1.0:1787387970.806100:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945647104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787387970.806124:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945645824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387970.806126:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387970.806158:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945645824:12345-0@lo:400:kworker.0 Request processed in 241us (7850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.806159:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945645568:0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.806164:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787387970.806169:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945646080:0@lo:400:kworker.0 00000100:00100000:1.0:1787387970.806188:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787387970.806196:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945647232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387970.806215:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945647104 00000100:00100000:1.0:1787387970.806219:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387970.806219:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945647104 00000100:00080000:1.0:1787387970.806238:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387970.806252:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945647232 00000100:00100000:0.0:1787387970.806255:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945647232 00000100:00100000:1.0:1787387970.806273:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787387970.806281:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945647104:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787387970.806288:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387970.806293:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945647232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387970.806309:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1787387970.806309:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387970.806341:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945647104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.806366:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787387970.807972:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945645696:0@lo:400:kworker.0 00000100:00100000:3.0:1787387970.807991:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945646208:0@lo:400:kworker.0 00000100:00100000:3.0:1787387970.808057:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387970.808099:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945646208 00000100:00100000:3.0:1787387970.808105:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945646208 00000100:00100000:2.0:1787387970.808147:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387970.808172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787387970.808178:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945646848:0@lo:400:kworker.0 00000100:00100000:3.0:1787387970.808185:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945646208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387970.808226:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387970.808250:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945646208:12345-0@lo:400:kworker.0 Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387970.808258:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787387970.808270:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945645824:0@lo:400:kworker.0 00000100:00080000:3.0:1787387970.808297:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787387970.808305:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945646336 00000100:00100000:2.0:1787387970.808310:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945646336 00010000:00080000:3.0:1787387970.808335:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f570000 x1874211945646208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387970.808367:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945646208:0@lo:400:kworker.0 00000100:00100000:3.0:1787387970.808376:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945646720:0@lo:400:kworker.0 00000100:00100000:2.0:1787387970.808381:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945646848 00000100:00100000:2.0:1787387970.808385:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945646848 00000100:00100000:2.0:1787387970.808406:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787387970.808413:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945646336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387970.809186:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387970.809204:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945646336:12345-0@lo:400:kworker.0 Request processed in 790us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387970.809215:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787387970.809228:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945646720 00000100:00100000:3.0:1787387970.809234:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945646720 00000100:00100000:2.0:1787387970.809238:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787387970.809249:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945646848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387970.809276:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787387970.809285:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945646848:12345-0@lo:400:kworker.0 Request processed in 39us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387970.809287:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945646720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387970.809297:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787387970.809323:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787387970.809328:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387970.809335:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945646720:12345-0@lo:400:kworker.0 Request processed in 50us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387970.809342:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1787387970.809610:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f573b80 x1874211945646336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387970.809621:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945647232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3322us (3395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387970.809628:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945646336:0@lo:400:kworker.0 00000100:00100000:0.0:1787387970.809635:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787387970.809704:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58b480 x1874211945646848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387970.809714:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945646848:0@lo:400:kworker.0 00010000:00080000:1.0:1787387970.809766:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f591880 x1874211945647232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387970.809786:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945647232:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787387970.809800:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58c380 x1874211945647104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387970.809812:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945647104:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787387970.810507:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58a300 x1874211945646720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387970.810544:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945646720:0@lo:400:kworker.0 00000100:00100000:1.0:1787387970.817273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387970.820338:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925661184 00000100:00100000:0.0:1787387970.820372:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925661184 00000100:00100000:0.0:1787387970.820484:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 246 00000100:00100000:0.0:1787387970.820497:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+8:6172:x1874211925661184:12345-192.168.203.15@tcp:101: 00010000:00010000:0.0:1787387970.820520:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387970.820542:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09800/0x26817551a44744ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7cc1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.820595:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09800/0x26817551a44744ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cc1 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.820620:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09800/0x26817551a44744ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cc1 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.820631:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09800, rc 0) 00000100:00100000:0.0:1787387970.820732:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+9:6172:x1874211925661184:12345-192.168.203.15@tcp:101: Request processed in 237us (3473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.820740:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 246 00000100:00100000:2.0:1787387970.824188:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387970.824376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925661312 00000100:00100000:0.0:1787387970.824387:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925661312 00000100:00100000:0.0:1787387970.824461:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 247 00000100:00100000:0.0:1787387970.824474:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+9:6172:x1874211925661312:12345-192.168.203.15@tcp:501: 00000100:00100000:0.0:1787387970.824673:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+9:6172:x1874211925661312:12345-192.168.203.15@tcp:501: Request processed in 200us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.824682:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 247 00000100:00100000:3.0:1787387970.826551:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387970.826656:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925661440 00000100:00100000:2.0:1787387970.826668:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925661440 00000100:00100000:2.0:1787387970.826744:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 248 00000100:00100000:2.0:1787387970.826755:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+9:6172:x1874211925661440:12345-192.168.203.15@tcp:503: 00000100:00100000:2.0:1787387970.826964:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+9:6172:x1874211925661440:12345-192.168.203.15@tcp:503: Request processed in 210us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387970.826975:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 248 00000100:00100000:3.0:1787387970.836648:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387970.839245:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925661568 00000100:00100000:1.0:1787387970.839270:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925661568 00000100:00100000:1.0:1787387970.839372:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 249 00000100:00100000:1.0:1787387970.839383:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+9:6679:x1874211925661568:12345-192.168.203.15@tcp:502: 00000100:00100000:1.0:1787387970.839774:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+9:6679:x1874211925661568:12345-192.168.203.15@tcp:502: Request processed in 392us (3146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387970.839782:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 249 00000100:00100000:1.0:1787387970.847153:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387970.847228:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925661696 00000100:00100000:0.0:1787387970.847236:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925661696 00000100:00100000:0.0:1787387970.847283:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00100000:0.0:1787387970.847300:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+9:6679:x1874211925661696:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787387970.847466:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+9:6679:x1874211925661696:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 165us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.847474:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00100000:3.0:1787387970.853125:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387970.853425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925661824 00000100:00100000:0.0:1787387970.853458:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925661824 00000100:00100000:0.0:1787387970.853843:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 251 00000100:00100000:0.0:1787387970.853872:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+9:6172:x1874211925661824:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387970.853894:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387970.853952:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09600/0x26817551a4474506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7cc8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.853990:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09600/0x26817551a4474506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cc8 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.854004:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09600/0x26817551a4474506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cc8 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387970.854028:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09600, rc 0) 00000100:00100000:0.0:1787387970.854114:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:6172:x1874211925661824:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 252us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387970.854122:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 251 00000100:00100000:2.0:1787387970.857026:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387970.858269:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925661952 00000100:00100000:1.0:1787387970.858285:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925661952 00000100:00100000:0.0:1787387970.858567:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 252 00000100:00100000:0.0:1787387970.858581:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6172:x1874211925661952:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387970.858827:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6172:x1874211925661952:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 249us (1821us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787387970.858836:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 252 00010000:00010000:0.0:1787387971.190804:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387971.825931:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387971.825970:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945647360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787387971.826065:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387971.826383:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945647360 00000100:00100000:2.0:1787387971.826394:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945647360 00000100:00100000:2.0:1787387971.826528:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787387971.826540:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945647360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787387971.826586:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787387971.826650:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945647360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.826658:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787387971.826753:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945647360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787387971.846040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387971.846088:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387971.846118:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387971.846154:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387971.846174:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387971.846205:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925662592 00000100:00100000:2.0:1787387971.846214:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925662592 00000100:00100000:2.0:1787387971.846266:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925662464 00000100:00100000:2.0:1787387971.846269:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925662464 00000100:00100000:2.0:1787387971.846291:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:2.0:1787387971.846300:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925662592:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787387971.846411:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925662592:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 112us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.846420:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:2.0:1787387971.846435:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:2.0:1787387971.846441:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925662464:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787387971.846464:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925662464:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387971.846470:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00080000:2.0:1787387971.846488:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787387971.846492:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387971.847254:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925662080 00000100:00100000:0.0:1787387971.847262:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925662080 00000100:00100000:0.0:1787387971.847307:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 253 00000100:00100000:0.0:1787387971.847315:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2399:x1874211925662080:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787387971.847387:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2399:x1874211925662080:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 72us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387971.847394:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 253 00000100:00100000:3.0:1787387971.848183:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925662336 00000100:00100000:3.0:1787387971.848189:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925662336 00000100:00100000:3.0:1787387971.848241:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925662208 00000100:00100000:3.0:1787387971.848244:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925662208 00000100:00100000:3.0:1787387971.848273:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:3.0:1787387971.848280:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925662336:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787387971.848324:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925662336:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 44us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.848330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:3.0:1787387971.848343:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:3.0:1787387971.848373:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2399:x1874211925662208:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787387971.848398:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2399:x1874211925662208:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387971.848403:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00080000:2.0:1787387971.850212:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787387971.850221:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787387972.204610:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387972.849189:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787387972.849221:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945647488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387972.849282:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387972.849292:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945647616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787387972.849320:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387972.849367:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387972.849422:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945647488 00000100:00100000:0.0:1787387972.849431:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945647488 00000100:00100000:2.0:1787387972.850150:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945647616 00000100:00100000:2.0:1787387972.850159:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945647616 00000100:00100000:2.0:1787387972.850300:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787387972.850312:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945647616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787387972.850377:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387972.850454:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945647616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (1085us total) trans 0 rc 0/0 00000100:00080000:0.0:1787387972.852881:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787387972.854486:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58fb80 x1874211945647616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387972.854520:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945647616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787387972.854771:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787387972.854792:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945647488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387972.854823:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387972.854939:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945647488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (5618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387972.854947:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787387972.854995:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311fb80 x1874211945647488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387972.855011:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945647488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387972.856603:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00000080:1.0:1787387972.885808:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe6fbaa840 00000020:00000080:1.0:1787387972.885840:0:10395:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787387972.885847:0:10395:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787387972.885857:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6fbacad0 20000000:00000080:1.0:1787387972.885866:0:10395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996a4321a800 uarg=0000000000000000 20000000:01000000:1.0:1787387972.885924:0:10395:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787387972.885931:0:10395:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787387972.885937:0:10395:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787387972.886936:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787387972.887229:0:10395:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787387972.892521:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787387972.892574:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787387972.892615:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787387972.892635:0:10395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787387972.892661:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.892685:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b70077200/0x26817551a44741a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44741a2 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.892694:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b40031200/0x26817551a44741b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44741b0 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.892701:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b821d7c00/0x26817551a447420b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474204 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.892708:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b40030c00/0x26817551a4474331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447432a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.892719:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b414a2400/0x26817551a4474449 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c89 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.892729:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.892780:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b414a2400/0x26817551a4474449 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c89 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.892796:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b414a2400/0x26817551a4474449 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c89 expref: 9 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387972.892816:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874211945647744:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787387972.892981:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b40030c00/0x26817551a4474331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a447432a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.892997:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b40030c00/0x26817551a4474331 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a447432a expref: 23 pid: 6515 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387972.893311:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f591880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874211945647872:0@lo:104: 00000100:00100000:1.0:1787387972.893514:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387972.893578:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945647872 00000100:00100000:3.0:1787387972.893588:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945647872 00000100:00100000:3.0:1787387972.893652:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787387972.893770:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:10395:x1874211945647872:12345-0@lo:104: 00010000:00010000:3.0:1787387972.893788:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387972.893859:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387972.893866:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:10395:x1874211945647872:12345-0@lo:104: Request processed in 99us (352us total) trans 0 rc 0/0 00010000:00010000:0.0:1787387972.893911:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387972.893920:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.893928:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787387972.893933:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.893943:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387972.893950:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387972.893958:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787387972.893996:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.894004:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387972.894037:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.894682:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b821d7c00/0x26817551a447420b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474204 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.894707:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b821d7c00/0x26817551a447420b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474204 expref: 23 pid: 6515 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.894721:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874211945648128:0@lo:104: 00000100:00100000:2.0:1787387972.894776:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787387972.894803:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b40031200/0x26817551a44741b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44741b0 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.894813:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b40031200/0x26817551a44741b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44741b0 expref: 23 pid: 6516 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.894821:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874211945648256:0@lo:104: 00010000:00010000:2.0:1787387972.894863:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b70077200/0x26817551a44741a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44741a2 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.894871:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b70077200/0x26817551a44741a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44741a2 expref: 23 pid: 6516 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.894880:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874211945648384:0@lo:104: 00000100:00100000:2.0:1787387972.894900:0:10395:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365480 going to sleep for 11 seconds 00000100:00100000:2.0:1787387972.894927:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f591880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874211945647872:0@lo:104: 00010000:00010000:0.0:1787387972.895580:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e09400/0x26817551a447432a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474331 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.895602:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387972.895604:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387972.895607:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387972.895618:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787387972.895639:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945648000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387972.895690:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387972.895853:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945648000 00000100:00100000:2.0:1787387972.895861:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945648000 00010000:00010000:2.0:1787387972.895899:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b40030c00/0x26817551a4474331 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447432a expref: 24 pid: 6515 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.895941:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787387972.895950:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945648000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787387972.895977:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387972.895983:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b40030c00/0x26817551a4474331 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447432a expref: 24 pid: 6515 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.895995:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b40030c00/0x26817551a4474331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a447432a expref: 24 pid: 6515 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.896014:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40030c00/0x26817551a4474331 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a447432a expref: 24 pid: 6515 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.896031:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787387972.896079:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3649:x1874211945648000:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387972.896087:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787387972.897427:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945648000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387972.899757:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787387972.899808:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387972.899873:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387972.899890:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787387972.899898:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387972.899901:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1787387972.899935:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925662720 00000100:00100000:2.0:1787387972.899946:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925662720 00000100:00100000:3.0:1787387972.899985:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1787387972.899993:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b414a2400/0x26817551a4474449 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c89 expref: 10 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387972.900028:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945648128 00000100:00100000:3.0:1787387972.900033:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945648128 00000100:00100000:2.0:1787387972.900038:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:2.0:1787387972.900052:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925662720:12345-192.168.203.15@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787387972.900058:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945648256 00000100:00100000:3.0:1787387972.900062:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945648256 00010000:00010000:2.0:1787387972.900070:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787387972.900073:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945648384 00000100:00100000:3.0:1787387972.900077:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945648384 00010000:00010000:2.0:1787387972.900080:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b414a2400/0x26817551a4474449 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c89 expref: 10 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387972.900092:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1787387972.900099:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b414a2400/0x26817551a4474449 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c89 expref: 10 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387972.900103:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43818450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+5:10395:x1874211945648128:12345-0@lo:104: 00010000:00010000:3.0:1787387972.900123:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.900147:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787387972.900402:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b414a2400/0x26817551a4474449 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c89 expref: 10 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387972.900417:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874211945647744:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787387972.901226:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c26a556f-3215-464e-beb8-43d9848a19a5+9:2402:x1874211925662720:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 1170us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387972.901237:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:2.0:1787387972.903621:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874211945648128:0@lo:104: 00010000:00010000:3.0:1787387972.903685:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787387972.903698:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43818450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+5:10395:x1874211945648128:12345-0@lo:104: Request processed in 3595us (8919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387972.903709:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787387972.903788:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787387972.903802:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+4:10395:x1874211945648256:12345-0@lo:104: 00010000:00010000:3.0:1787387972.903821:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.903945:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874211945648256:0@lo:104: 00010000:00010000:0.0:1787387972.904233:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787387972.904242:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904251:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b821d6800 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787387972.904256:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904266:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387972.904275:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387972.904299:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787387972.904382:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904390:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387972.904440:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904448:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b821d6800/0x26817551a4474204 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447420b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904464:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787387972.904468:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904474:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787387972.904477:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904484:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787387972.904491:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387972.904497:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787387972.904514:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387972.904520:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945648512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387972.904522:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787387972.904535:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904543:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b40031a00/0x26817551a44741b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44741b7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387972.904557:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387972.904559:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387972.904573:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945648640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787387972.904594:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387972.904623:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387972.904674:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945648512 00000100:00100000:0.0:1787387972.904682:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945648512 00010000:00010000:0.0:1787387972.904710:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b821d7c00/0x26817551a447420b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474204 expref: 23 pid: 6515 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.904729:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945648640 00000100:00100000:2.0:1787387972.904736:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945648640 00000100:00100000:0.0:1787387972.904750:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1787387972.904759:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b40031200/0x26817551a44741b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44741b0 expref: 24 pid: 6516 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387972.904761:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945648512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387972.904780:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787387972.904789:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b821d7c00/0x26817551a447420b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474204 expref: 24 pid: 6515 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.904794:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787387972.904808:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945648640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787387972.904808:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b821d7c00/0x26817551a447420b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474204 expref: 24 pid: 6515 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904828:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b821d7c00/0x26817551a447420b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474204 expref: 24 pid: 6515 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.904839:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787387972.904848:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b40031200/0x26817551a44741b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44741b0 expref: 24 pid: 6516 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.904859:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787387972.904862:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b40031200/0x26817551a44741b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44741b0 expref: 23 pid: 6516 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.904881:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40031200/0x26817551a44741b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44741b0 expref: 23 pid: 6516 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.904893:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787387972.904895:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:3651:x1874211945648512:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387972.904910:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387972.904940:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3652:x1874211945648640:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387972.904948:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945648640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787387972.904950:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787387972.904974:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945648512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387972.905744:0:10397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787387972.905755:0:10397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+4:10395:x1874211945648384:12345-0@lo:104: 00010000:00010000:0.0:1787387972.905769:0:10397:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b40031400/0x26817551a44741a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387972.905858:0:10397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787387972.905864:0:10397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+4:10395:x1874211945648384:12345-0@lo:104: Request processed in 112us (5992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387972.905871:0:10397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787387972.905920:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787387972.905927:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b40031400/0x26817551a44741a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.905934:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787387972.905939:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b40031400/0x26817551a44741a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.905948:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b40031400/0x26817551a44741a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787387972.905956:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b40031400/0x26817551a44741a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787387972.905961:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787387972.906000:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b40031400/0x26817551a44741a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906019:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787387972.906037:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b40031400/0x26817551a44741a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906044:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b40031400/0x26817551a44741a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44741a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906060:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387972.906062:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387972.906063:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387972.906105:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945648768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787387972.906139:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387972.906223:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945648768 00000100:00100000:1.0:1787387972.906230:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945648768 00010000:00010000:1.0:1787387972.906256:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b70077200/0x26817551a44741a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44741a2 expref: 21 pid: 6516 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787387972.906277:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787387972.906284:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3649:x1874211945648768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787387972.906293:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787387972.906299:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b70077200/0x26817551a44741a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44741a2 expref: 21 pid: 6516 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906308:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b70077200/0x26817551a44741a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44741a2 expref: 21 pid: 6516 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906325:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906335:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906389:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906396:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906404:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906410:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906428:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787387972.906433:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906441:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906449:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387972.906460:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787387972.906489:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3649:x1874211945648768:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387972.906495:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1787387972.906605:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787387972.906606:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787387972.906624:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:10395:x1874211945648256:12345-0@lo:104: Request processed in 2825us (6817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387972.906633:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945648768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787387972.906635:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1787387972.907911:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70077200/0x26817551a44741a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44741a2 expref: 20 pid: 6516 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387972.907932:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874211945648384:0@lo:104: 00010000:00010000:2.0:1787387972.907982:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.907994:0:10395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.908001:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387972.908007:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70076400/0x26817551a447450d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787387973.231487:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387974.252807:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387974.273376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387974.273450:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925662848 00000100:00100000:3.0:1787387974.273459:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925662848 00000100:00100000:3.0:1787387974.273519:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 254 00000100:00100000:3.0:1787387974.273528:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+9:6172:x1874211925662848:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787387974.273543:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787387974.273560:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b414a3400/0x26817551a4474514 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ccf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387974.273584:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b414a3400/0x26817551a4474514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ccf expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387974.273595:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b414a3400/0x26817551a4474514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ccf expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787387974.273614:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b414a3400, rc 0) 00000100:00100000:3.0:1787387974.273667:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+10:6172:x1874211925662848:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 131us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.273674:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 254 00000100:00100000:3.0:1787387974.280528:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387974.280561:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925662976 00000100:00100000:3.0:1787387974.280569:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925662976 00000100:00100000:3.0:1787387974.280644:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 255 00000100:00100000:3.0:1787387974.280654:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6172:x1874211925662976:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787387974.280807:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6172:x1874211925662976:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 153us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.280837:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 255 00000100:00100000:2.0:1787387974.299011:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387974.299072:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925663104 00000100:00100000:3.0:1787387974.299081:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925663104 00000100:00100000:3.0:1787387974.299128:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 256 00000100:00100000:3.0:1787387974.299137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:6172:x1874211925663104:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387974.299266:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:6172:x1874211925663104:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 130us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.299274:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 256 00000100:00100000:1.0:1787387974.322125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387974.330148:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925663232 00000100:00100000:3.0:1787387974.330162:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925663232 00000100:00100000:2.0:1787387974.331778:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 257 00000100:00100000:2.0:1787387974.331791:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+10:6736:x1874211925663232:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787387974.331935:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+10:6736:x1874211925663232:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 147us (9818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387974.331943:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 257 00000100:00100000:1.0:1787387974.340587:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387974.340698:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925663360 00000100:00100000:1.0:1787387974.340718:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925663360 00000100:00100000:1.0:1787387974.340765:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 258 00000100:00100000:1.0:1787387974.340774:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6736:x1874211925663360:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787387974.340917:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:6736:x1874211925663360:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 143us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387974.340925:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 258 10000000:01000000:2.0:1787387974.388192:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787387974.388199:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b7f53f000 from 4 10000000:01000000:2.0:1787387974.388205:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387974.388253:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.388266:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.388292:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387974.388319:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945648896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387974.388684:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387974.388742:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea240 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.388758:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945648896 00000100:00100000:0.0:1787387974.388765:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945648896 00000100:00100000:0.0:1787387974.388815:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787387974.388833:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945648896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387974.388847:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387974.388859:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09000/0x26817551a4474522 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447451b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.388894:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09000/0x26817551a4474522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447451b expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.388905:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09000/0x26817551a4474522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447451b expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.388913:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09000, rc 0) 00000100:00100000:0.0:1787387974.388959:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945648896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.388966:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787387974.389033:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945648896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387974.389048:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.389056:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387974.389110:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945649024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.389134:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387974.389148:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5dc4b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.389159:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945649024 00000100:00100000:0.0:1787387974.389163:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945649024 00000100:00100000:0.0:1787387974.389185:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787387974.389192:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945649024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.389317:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945649024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.389331:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787387974.389384:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945649024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.389411:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945649152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.389448:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387974.389462:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5dc4b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.389472:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945649152 00000100:00100000:0.0:1787387974.389475:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945649152 00000100:00100000:0.0:1787387974.389492:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787387974.389497:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945649152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.389571:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945649152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.389577:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787387974.389740:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945649152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.389928:0:10437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10437:1874211945649280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387974.389961:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387974.389978:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945649280 00000100:00100000:0.0:1787387974.389982:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945649280 00000100:00100000:0.0:1787387974.390151:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787387974.390158:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:10437:x1874211945649280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387974.390226:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:10437:x1874211945649280:12345-0@lo:502:llog_process_th.0 Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.390301:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787387974.390332:0:10437:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5dc4bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.390344:0:10437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10437:1874211945649280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387974.390386:0:10437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787387974.390395:0:10437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387974.390397:0:10437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787387974.390403:0:10437:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b7f53f000 00000020:00000080:0.0:1787387974.390406:0:10437:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787387974.390477:0:10437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10437:1874211945649408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387974.390508:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387974.390524:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945649408 00000100:00100000:0.0:1787387974.390527:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945649408 00000100:00100000:0.0:1787387974.390546:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787387974.390550:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:10437:x1874211945649408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387974.390602:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:10437:x1874211945649408:12345-0@lo:502:llog_process_th.0 Request processed in 51us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.390608:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787387974.392427:0:10437:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b45005900 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.392453:0:10437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10437:1874211945649408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787387974.392483:0:10437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787387974.392490:0:10437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787387974.392492:0:10437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787387974.392496:0:10437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787387974.392565:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787387974.392583:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387974.392592:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.392604:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387974.394373:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787387974.394376:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b74ea1800 from 4 10000000:01000000:0.0:1787387974.394378:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387974.394415:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.394423:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.394433:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387974.394457:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945649536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.394518:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387974.394559:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b45005900 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.394581:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945649536 00000100:00100000:0.0:1787387974.394587:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945649536 00000100:00100000:0.0:1787387974.397893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787387974.397910:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945649536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387974.397928:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787387974.397946:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e08c00/0x26817551a4474530 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474529 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.397974:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e08c00/0x26817551a4474530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474529 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.397986:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e08c00/0x26817551a4474530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474529 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.398007:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08c00, rc 0) 00000100:00100000:0.0:1787387974.398084:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945649536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.398091:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787387974.398136:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945649536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387974.398152:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.398161:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387974.398231:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945649664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.398263:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387974.427262:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945649664 00000100:00100000:1.0:1787387974.427278:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945649664 00000100:00100000:1.0:1787387974.427332:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787387974.427341:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945649664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387974.427518:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945649664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (29252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387974.427526:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787387974.432995:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b45005900 going to sleep for 11 seconds 00000100:00100000:1.0:1787387974.433039:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945649664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787387974.433096:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945649792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387974.433164:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387974.433196:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945649792 00000100:00100000:1.0:1787387974.433202:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945649792 00000100:00100000:1.0:1787387974.433235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787387974.433243:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945649792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787387974.433338:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945649792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387974.433365:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787387974.433403:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b433673c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787387974.433421:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945649792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387974.447298:0:10444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10444:1874211945649920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387974.447414:0:10444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387974.447449:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945649920 00000100:00100000:2.0:1787387974.447456:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945649920 00000100:00100000:2.0:1787387974.447495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787387974.447504:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:10444:x1874211945649920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387974.447616:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:10444:x1874211945649920:12345-0@lo:502:llog_process_th.0 Request processed in 112us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387974.447624:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787387974.447671:0:10444:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387974.447692:0:10444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10444:1874211945649920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387974.447716:0:10444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387974.447726:0:10444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387974.447728:0:10444:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787387974.447733:0:10444:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b74ea1800 00000020:00000080:2.0:1787387974.447735:0:10444:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787387974.448254:0:10444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10444:1874211945650048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387974.448288:0:10444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387974.448309:0:10444:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.448443:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945650048 00000100:00100000:0.0:1787387974.448447:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945650048 00000100:00100000:0.0:1787387974.448476:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787387974.448483:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:10444:x1874211945650048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387974.448552:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:10444:x1874211945650048:12345-0@lo:502:llog_process_th.0 Request processed in 69us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.448559:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787387974.449110:0:10444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10444:1874211945650048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387974.449132:0:10444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387974.449139:0:10444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387974.449141:0:10444:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787387974.449144:0:10444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787387974.449196:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787387974.449213:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787387974.449223:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.449247:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787387974.449257:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787387974.449259:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b73aa7800 from 4 10000000:01000000:2.0:1787387974.449262:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787387974.449285:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.449292:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.449301:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387974.449314:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945650176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787387974.449344:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387974.449380:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387974.449393:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945650176 00000100:00100000:2.0:1787387974.449397:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945650176 00000100:00100000:2.0:1787387974.449432:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787387974.449439:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945650176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387974.449449:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387974.449460:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e4a00/0x26817551a447453e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474537 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.449481:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e4a00/0x26817551a447453e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474537 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.449491:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e4a00/0x26817551a447453e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474537 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.449500:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4a00, rc 0) 00000100:00100000:2.0:1787387974.449527:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945650176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387974.449534:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787387974.449557:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945650176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387974.449569:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.449578:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787387974.449620:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945650304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387974.449642:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387974.449654:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387974.449666:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945650304 00000100:00100000:2.0:1787387974.449669:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945650304 00000100:00100000:2.0:1787387974.449693:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787387974.449699:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945650304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387974.449783:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945650304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387974.449790:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787387974.449815:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945650304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787387974.449853:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945650432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787387974.449886:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387974.449898:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787387974.449908:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945650432 00000100:00100000:2.0:1787387974.449911:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945650432 00000100:00100000:2.0:1787387974.449927:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787387974.449932:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945650432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387974.452724:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945650432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387974.453799:0:10445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10445:1874211945650560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387974.454428:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945650432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4491us (4537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387974.454439:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787387974.456440:0:10445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387974.456483:0:10445:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4607e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.456558:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945650560 00000100:00100000:0.0:1787387974.456566:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945650560 00000100:00100000:0.0:1787387974.456607:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787387974.456615:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:10445:x1874211945650560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387974.456740:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:10445:x1874211945650560:12345-0@lo:502:llog_process_th.0 Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.456753:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787387974.457566:0:10445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10445:1874211945650560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387974.457600:0:10445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787387974.457610:0:10445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387974.457612:0:10445:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787387974.457619:0:10445:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b73aa7800 00000020:00000080:2.0:1787387974.457621:0:10445:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787387974.457710:0:10445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10445:1874211945650688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387974.457757:0:10445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387974.457789:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945650688 00000100:00100000:2.0:1787387974.457794:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945650688 00000100:00100000:2.0:1787387974.457835:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787387974.457843:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:10445:x1874211945650688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787387974.457913:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:10445:x1874211945650688:12345-0@lo:502:llog_process_th.0 Request processed in 70us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387974.457919:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787387974.457951:0:10445:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431eed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787387974.457963:0:10445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10445:1874211945650688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787387974.457981:0:10445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787387974.457986:0:10445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787387974.457987:0:10445:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787387974.460553:0:10445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787387974.464831:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787387974.464869:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387974.464881:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.464893:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787387974.464905:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787387974.464907:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b46a34000 from 4 10000000:01000000:0.0:1787387974.464910:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787387974.464950:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.464959:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.464970:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387974.465005:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945650816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.465069:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387974.465145:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:2.0:1787387974.466413:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945650816 00000100:00100000:2.0:1787387974.466422:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945650816 00000100:00100000:2.0:1787387974.466470:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787387974.466479:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945650816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787387974.466494:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787387974.466508:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e5200/0x26817551a447454c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474545 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.466532:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e5200/0x26817551a447454c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474545 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.466542:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e5200/0x26817551a447454c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474545 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787387974.466551:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e5200, rc 0) 00000100:00100000:2.0:1787387974.466643:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945650816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387974.466658:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787387974.469767:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945650816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787387974.469793:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.469805:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787387974.469913:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945650944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.469966:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387974.470014:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.470107:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945650944 00000100:00100000:0.0:1787387974.470113:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945650944 00000100:00100000:0.0:1787387974.470158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787387974.470166:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945650944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.470293:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945650944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.470301:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787387974.470336:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945650944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.470384:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945651072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.470422:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387974.470436:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.470449:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945651072 00000100:00100000:0.0:1787387974.470453:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945651072 00000100:00100000:0.0:1787387974.470476:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787387974.470482:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945651072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787387974.470557:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945651072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.470564:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787387974.470602:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945651072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787387974.471185:0:10446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10446:1874211945651200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387974.471220:0:10446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387974.471248:0:10446:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4607e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787387974.471371:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945651200 00000100:00100000:0.0:1787387974.471381:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945651200 00000100:00100000:0.0:1787387974.471403:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787387974.471409:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:10446:x1874211945651200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787387974.471480:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:10446:x1874211945651200:12345-0@lo:502:llog_process_th.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387974.471486:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787387974.471560:0:10446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10446:1874211945651200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387974.471582:0:10446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787387974.471590:0:10446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387974.471592:0:10446:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787387974.471598:0:10446:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b46a34000 00000020:00000080:3.0:1787387974.471601:0:10446:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787387974.471671:0:10446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10446:1874211945651328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387974.471704:0:10446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387974.471722:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945651328 00000100:00100000:3.0:1787387974.471732:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945651328 00000100:00100000:3.0:1787387974.471756:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787387974.471762:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:10446:x1874211945651328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787387974.471842:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:10446:x1874211945651328:12345-0@lo:502:llog_process_th.0 Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.471850:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787387974.471876:0:10446:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4607e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787387974.471888:0:10446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:10446:1874211945651328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787387974.471906:0:10446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787387974.471910:0:10446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787387974.471911:0:10446:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787387974.471915:0:10446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787387974.472508:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787387974.472527:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787387974.472536:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787387974.472549:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787387974.894202:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387974.894225:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945651456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787387974.894303:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387974.894471:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945651456 00000100:00100000:3.0:1787387974.894479:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945651456 00000100:00100000:3.0:1787387974.894528:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787387974.894537:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945651456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787387974.894572:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787387974.894618:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945651456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387974.894624:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787387974.894668:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945651456:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787387975.281966:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387975.917519:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945651584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787387975.917644:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387975.917691:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787387975.917698:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945651712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387975.917721:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387975.917750:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945651584 00000100:00100000:1.0:1787387975.917757:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945651584 00000100:00100000:1.0:1787387975.917826:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945651712 00000100:00100000:1.0:1787387975.917829:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945651712 00000100:00100000:1.0:1787387975.917848:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787387975.917855:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945651584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787387975.917883:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387975.917922:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945651584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.917930:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787387975.917946:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787387975.917951:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945651712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787387975.917961:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387975.917984:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945651712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.917989:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787387975.918023:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43909500 x1874211945651712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387975.918041:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945651712:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787387975.918067:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43908e00 x1874211945651584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387975.918076:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945651584:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787387975.922234:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387975.922317:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387975.922336:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945651840:0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.922421:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387975.922476:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945651840 00000100:00100000:0.0:1787387975.922483:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945651840 00000100:00100000:0.0:1787387975.922526:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787387975.922534:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945651840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.922583:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945651840:12345-0@lo:400:kworker.0 Request processed in 49us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387975.922590:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787387975.922649:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945651840:0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.922686:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945651968:0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.922764:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387975.922849:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387975.922856:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945652352:0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.922895:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387975.922934:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945652480:0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.922957:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387975.923003:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387975.923009:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945652864:0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.923033:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387975.923059:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945652864 00000100:00100000:0.0:1787387975.923062:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945652864 00000100:00100000:0.0:1787387975.923103:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787387975.923110:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945652864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.923144:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945652864:12345-0@lo:400:kworker.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387975.923150:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787387975.923164:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787387975.923182:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f572a00 x1874211945652864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387975.923193:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945652864:0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.923237:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945652992:0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.923258:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387975.923470:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945652096:0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.923500:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387975.923521:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945652608:0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.923541:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387975.923559:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945653120:0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.923582:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387975.923594:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787387975.923612:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945652224:0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.923631:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387975.923641:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945652736:0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.923657:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387975.923684:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945651968 00000100:00100000:1.0:1787387975.923689:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945651968 00000100:00100000:1.0:1787387975.923712:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945652480 00000100:00100000:1.0:1787387975.923714:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945652480 00000100:00100000:1.0:1787387975.923732:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945652992 00000100:00100000:1.0:1787387975.923735:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945652992 00000100:00100000:1.0:1787387975.923767:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945652608 00000100:00100000:1.0:1787387975.923770:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945652608 00000100:00100000:1.0:1787387975.923782:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945653120 00000100:00100000:1.0:1787387975.923785:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945653120 00000100:00100000:1.0:1787387975.923796:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945652224 00000100:00100000:1.0:1787387975.923799:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945652224 00000100:00100000:1.0:1787387975.923821:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787387975.923834:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945651968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.923872:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945651968:12345-0@lo:400:kworker.0 Request processed in 39us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.923878:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787387975.923891:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787387975.923898:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945652480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.923923:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945652480:12345-0@lo:400:kworker.0 Request processed in 26us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.923928:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787387975.923938:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787387975.923944:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945652992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.923969:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945652992:12345-0@lo:400:kworker.0 Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.923974:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787387975.923983:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787387975.923988:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945652608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.924017:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945652608:12345-0@lo:400:kworker.0 Request processed in 29us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.924022:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787387975.924032:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787387975.924038:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945653120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.924063:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945653120:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.924069:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787387975.924079:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787387975.924091:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945652224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.924118:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945652224:12345-0@lo:400:kworker.0 Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.924124:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787387975.924143:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945652736 00000100:00100000:1.0:1787387975.924147:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945652736 00000100:00100000:1.0:1787387975.924169:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387975.924175:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945652736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.924202:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945652736:12345-0@lo:400:kworker.0 Request processed in 28us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387975.924209:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787387975.924233:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945652224:0@lo:400:kworker.0 00010000:00080000:1.0:1787387975.924244:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f573480 x1874211945652736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387975.924254:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945652736:0@lo:400:kworker.0 00010000:00080000:1.0:1787387975.924263:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f573b80 x1874211945652608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387975.924272:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945652608:0@lo:400:kworker.0 00010000:00080000:1.0:1787387975.924280:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f572d80 x1874211945653120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387975.924287:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945653120:0@lo:400:kworker.0 00000100:00080000:1.0:1787387975.924310:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787387975.924314:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787387975.924316:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787387975.924344:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945652992:0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.924372:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945652480:0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.924383:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945651968:0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.926428:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945652352 00000100:00100000:0.0:1787387975.926441:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945652352 00000100:00100000:0.0:1787387975.926482:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945652096 00000100:00100000:0.0:1787387975.926486:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945652096 00000100:00100000:0.0:1787387975.926519:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787387975.926527:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945652352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.926620:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945652352:12345-0@lo:400:kworker.0 Request processed in 92us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387975.926626:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787387975.926642:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787387975.926648:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945652096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387975.926682:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945652096:12345-0@lo:400:kworker.0 Request processed in 34us (3181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387975.926688:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787387975.926963:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945652096:0@lo:400:kworker.0 00000100:00100000:1.0:1787387975.926996:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945652352:0@lo:400:kworker.0 00010000:00010000:0.0:1787387976.300660:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787387976.941825:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945653248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787387976.941927:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387976.943435:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945653248 00000100:00100000:2.0:1787387976.943449:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945653248 00000100:00100000:2.0:1787387976.943530:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787387976.943539:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945653248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787387976.943574:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787387976.943953:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945653248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 413us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387976.943962:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787387976.944018:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945653248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787387976.977894:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387976.977951:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387976.978022:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925663744 00000100:00100000:1.0:1787387976.978041:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925663744 00000100:00100000:0.0:1787387976.978101:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925663488 00000100:00100000:0.0:1787387976.978112:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925663488 00000100:00100000:1.0:1787387976.978140:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 85 00000100:00100000:1.0:1787387976.978155:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925663744:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787387976.978187:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 280 00000100:00100000:0.0:1787387976.978200:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2401:x1874211925663488:12345-192.168.203.15@tcp:400:kworker.0 00000100:00080000:3.0:1787387976.978400:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787387976.978416:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925663744:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 263us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387976.978426:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 85 00000100:00100000:0.0:1787387976.987320:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2401:x1874211925663488:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 9107us (9425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387976.987339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 280 00000100:00100000:2.0:1787387976.988621:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387976.988708:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387976.988749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787387976.988793:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925664000 00000100:00100000:2.0:1787387976.988813:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925664000 00000100:00100000:2.0:1787387976.988883:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925663872 00000100:00100000:2.0:1787387976.988887:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925663872 00000100:00100000:2.0:1787387976.988912:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:3.0:1787387976.989204:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925663616 00000100:00100000:3.0:1787387976.989209:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925663616 00000100:00100000:3.0:1787387976.989266:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 86 00000100:00100000:3.0:1787387976.989277:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925663616:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787387976.989387:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925663616:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 111us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387976.989395:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 86 00000100:00100000:2.0:1787387976.989540:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925664000:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787387976.989571:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925664000:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 36us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387976.989659:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:3.0:1787387976.989668:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925663872:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787387976.989695:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925663872:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 29us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387976.989703:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00080000:3.0:1787387976.989883:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387976.989890:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387976.989893:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387976.999539:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00010000:00010000:1.0:1787387977.324540:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387977.965412:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387977.965437:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945653376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387977.965519:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387977.966462:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945653376 00000100:00100000:1.0:1787387977.966480:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945653376 00000100:00100000:1.0:1787387977.966543:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787387977.966554:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945653376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387977.966581:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387977.966646:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945653376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387977.966654:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787387977.966829:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387977.966874:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787387977.966888:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945653504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787387977.966922:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787387977.966990:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43909c00 x1874211945653376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387977.967007:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945653376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387977.967183:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945653504 00000100:00100000:0.0:1787387977.967189:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945653504 00000100:00100000:0.0:1787387977.967238:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787387977.967247:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945653504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787387977.967270:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387977.967308:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945653504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387977.967315:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787387977.967341:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f570380 x1874211945653504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387977.967376:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945653504:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787387977.968019:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787387978.352105:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387979.372561:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387980.012485:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787387980.012508:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945653632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787387980.012576:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387980.012647:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945653632 00000100:00100000:3.0:1787387980.012655:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945653632 00000100:00100000:3.0:1787387980.012701:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787387980.012726:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945653632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787387980.012758:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787387980.012814:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945653632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387980.012821:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787387980.012868:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945653632:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787387980.196058:0:10696:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787387980.398705:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387981.037384:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945653760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787387981.037452:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387981.037579:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945653760 00000100:00100000:2.0:1787387981.037592:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945653760 00000100:00100000:2.0:1787387981.037649:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787387981.037660:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945653760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787387981.037687:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387981.037726:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945653760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387981.037733:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787387981.037927:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787387981.037961:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311e300 x1874211945653760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387981.037977:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945653760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787387981.038834:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787387981.038846:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945653888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787387981.038891:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.038978:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945653888 00000100:00100000:0.0:1787387981.038983:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945653888 00000100:00100000:0.0:1787387981.039037:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787387981.039045:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945653888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787387981.039060:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387981.039094:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945653888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.039101:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787387981.039130:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f570380 x1874211945653888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387981.039146:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945653888:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787387981.039268:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787387981.039725:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945654016:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.039762:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387981.039837:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945654016 00000100:00100000:3.0:1787387981.039842:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945654016 00000100:00100000:3.0:1787387981.039873:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787387981.039880:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945654016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387981.040045:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945654016:12345-0@lo:400:kworker.0 Request processed in 166us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.040053:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787387981.040276:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945654016:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.040292:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945654528:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.040318:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.040405:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945655040:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.040429:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.040447:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787387981.040453:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945654400:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.040474:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.040492:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945654912:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.040510:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.040535:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945655040 00000100:00100000:0.0:1787387981.040539:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945655040 00000100:00100000:0.0:1787387981.040571:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945654912 00000100:00100000:0.0:1787387981.040574:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945654912 00000100:00100000:0.0:1787387981.040660:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787387981.040670:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945655040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.040707:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945655040:12345-0@lo:400:kworker.0 Request processed in 39us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.040714:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787387981.040724:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787387981.040730:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945654912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.040753:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945654912:12345-0@lo:400:kworker.0 Request processed in 24us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.040758:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787387981.040802:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4390a680 x1874211945654912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387981.040826:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945654912:0@lo:400:kworker.0 00010000:00080000:0.0:1787387981.040837:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43909180 x1874211945655040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387981.040844:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945655040:0@lo:400:kworker.0 00000100:00080000:0.0:1787387981.040860:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387981.040888:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945654144:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.040911:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.040990:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945654656:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.041011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.041101:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945655168:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.041123:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.041142:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787387981.041149:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945654272:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.041170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.041463:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945654784:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.041488:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.041498:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945655296:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.041514:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387981.041533:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945654400 00000100:00100000:0.0:1787387981.041537:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945654400 00000100:00100000:0.0:1787387981.041561:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945654144 00000100:00100000:0.0:1787387981.041564:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945654144 00000100:00100000:0.0:1787387981.041574:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945654656 00000100:00100000:0.0:1787387981.041576:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945654656 00000100:00100000:0.0:1787387981.041626:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945655168 00000100:00100000:0.0:1787387981.041630:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945655168 00000100:00100000:0.0:1787387981.041643:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945654784 00000100:00100000:0.0:1787387981.041645:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945654784 00000100:00100000:0.0:1787387981.041657:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945655296 00000100:00100000:0.0:1787387981.041659:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945655296 00000100:00100000:0.0:1787387981.041672:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787387981.041677:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945654400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.041716:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945654400:12345-0@lo:400:kworker.0 Request processed in 38us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.041723:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787387981.041736:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787387981.041742:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945654144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.041771:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945654144:12345-0@lo:400:kworker.0 Request processed in 30us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.041794:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787387981.041811:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787387981.041816:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945654656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.041843:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945654656:12345-0@lo:400:kworker.0 Request processed in 27us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.041847:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787387981.041858:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787387981.041864:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945655168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.041890:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945655168:12345-0@lo:400:kworker.0 Request processed in 27us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.041896:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787387981.041907:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787387981.041931:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945654784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.041961:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945654784:12345-0@lo:400:kworker.0 Request processed in 33us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.041968:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787387981.041979:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787387981.041984:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945655296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.042007:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945655296:12345-0@lo:400:kworker.0 Request processed in 23us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387981.042012:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787387981.042498:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945654528 00000100:00100000:3.0:1787387981.042505:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945654528 00000100:00100000:3.0:1787387981.042531:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945654272 00000100:00100000:3.0:1787387981.042533:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945654272 00000100:00100000:3.0:1787387981.042547:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787387981.042554:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945654528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.042697:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945654400:0@lo:400:kworker.0 00010000:00080000:0.0:1787387981.042727:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43909c00 x1874211945654784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387981.042737:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945654784:0@lo:400:kworker.0 00010000:00080000:0.0:1787387981.042747:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58d180 x1874211945655296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787387997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387981.042754:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945655296:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.042764:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945654144:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.042784:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945654656:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.042795:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945655168:0@lo:400:kworker.0 00000100:00080000:0.0:1787387981.042818:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787387981.042821:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387981.043002:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945654528:12345-0@lo:400:kworker.0 Request processed in 448us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.043009:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787387981.043090:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787387981.043098:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945654272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387981.043138:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945654272:12345-0@lo:400:kworker.0 Request processed in 42us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387981.043144:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787387981.043172:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945654272:0@lo:400:kworker.0 00000100:00100000:0.0:1787387981.043232:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945654528:0@lo:400:kworker.0 00010000:00010000:1.0:1787387981.424193:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387982.060587:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945655424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787387982.060660:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387982.060817:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945655424 00000100:00100000:3.0:1787387982.060825:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945655424 00000100:00100000:3.0:1787387982.060888:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787387982.060897:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945655424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787387982.060931:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787387982.062406:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945655424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1503us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387982.062419:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787387982.065503:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945655424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787387982.092173:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387982.092226:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387982.092269:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387982.092396:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925664384 00000100:00100000:3.0:1787387982.092405:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925664384 00000100:00100000:3.0:1787387982.092467:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925664256 00000100:00100000:3.0:1787387982.092470:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925664256 00000100:00100000:3.0:1787387982.092489:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 93 00000100:00100000:3.0:1787387982.092496:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925664384:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787387982.092563:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925664384:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 67us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387982.092570:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 93 00000100:00100000:3.0:1787387982.092598:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 94 00000100:00100000:3.0:1787387982.092604:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925664256:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787387982.092628:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925664256:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387982.092641:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 94 00000100:00080000:0.0:1787387982.092909:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787387982.092914:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787387982.094048:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925664128 00000100:00100000:2.0:1787387982.094059:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925664128 00000100:00100000:2.0:1787387982.094173:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 282 00000100:00100000:2.0:1787387982.094183:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925664128:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787387982.094233:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925664128:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 52us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387982.094240:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 282 00000100:00100000:3.0:1787387982.097092:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387982.097495:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387982.098233:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925664512 00000100:00100000:0.0:1787387982.098245:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925664512 00000100:00100000:1.0:1787387982.098447:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925664640 00000100:00100000:1.0:1787387982.098452:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925664640 00000100:00080000:2.0:1787387982.098565:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787387982.098569:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387982.098620:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:0.0:1787387982.098728:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2398:x1874211925664512:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:0.0:1787387982.098829:0:8434:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447445e 00000100:00080000:0.0:1787387982.098841:0:8434:0:(import.c:65:import_set_state_nolock()) ffff996a42d83800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787387982.098930:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787387982.099106:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+2:2398:x1874211925664512:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 477us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387982.099115:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:1.0:1787387982.099964:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:1.0:1787387982.099976:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2398:x1874211925664640:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:1.0:1787387982.100004:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474465 00000100:00080000:1.0:1787387982.100012:0:8437:0:(import.c:65:import_set_state_nolock()) ffff996a42d86000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787387982.101153:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787387982.101382:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787387982.101696:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+2:2398:x1874211925664640:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 1719us (4209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387982.101707:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00010000:00010000:0.0:1787387982.101808:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387982.444961:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387983.084623:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945655552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787387983.084694:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387983.084759:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945655552 00000100:00100000:0.0:1787387983.084777:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945655552 00000100:00080000:2.0:1787387983.084843:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787387983.084844:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787387983.084853:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945655552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787387983.084881:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387983.084942:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945655552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387983.084950:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787387983.084978:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4390b800 x1874211945655552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387983.084995:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945655552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787387983.087431:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787387983.087454:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945655680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387983.087521:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387983.087565:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945655680 00000100:00100000:1.0:1787387983.087572:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945655680 00000100:00100000:1.0:1787387983.087622:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787387983.087631:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945655680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387983.087652:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387983.087693:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945655680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387983.087700:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787387983.087741:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58ce00 x1874211945655680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787387999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387983.087759:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945655680:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787387983.088390:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787387983.470983:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787387984.496866:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387985.133788:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787387985.133810:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945655808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787387985.133872:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387985.133959:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945655808 00000100:00100000:3.0:1787387985.133966:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945655808 00000100:00100000:3.0:1787387985.134012:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787387985.134020:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945655808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787387985.134052:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787387985.134102:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945655808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387985.134109:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787387985.134155:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945655808:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787387985.516583:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387986.157162:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787387986.157204:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945655936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387986.157293:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387986.159039:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945655936 00000100:00100000:0.0:1787387986.159055:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945655936 00000100:00100000:2.0:1787387986.159135:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945656064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787387986.159142:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787387986.159158:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945655936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787387986.159192:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387986.159241:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387986.159290:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945655936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387986.159298:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787387986.159327:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945656064 00000100:00100000:0.0:1787387986.159331:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945656064 00000100:00100000:0.0:1787387986.159407:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787387986.159415:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945656064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787387986.159425:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387986.159455:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945656064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387986.159461:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787387986.159527:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311d880 x1874211945655936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387986.159555:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945655936:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787387986.159594:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311f800 x1874211945656064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387986.159607:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945656064:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787387986.159872:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387986.162980:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945656192:0@lo:400:kworker.0 00000100:00100000:2.0:1787387986.163062:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.163082:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945656320:0@lo:400:kworker.0 00000100:00100000:2.0:1787387986.163126:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945656704:0@lo:400:kworker.0 00000100:00100000:2.0:1787387986.163165:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387986.163187:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945657216:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.163192:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.173997:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945656832:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.174099:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.174148:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945657344:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.174394:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.174534:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945656448:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.174589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.174619:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945656960:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.174650:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.174682:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945657472:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.174715:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.174763:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787387986.174773:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945656576:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.174804:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.174826:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945657088:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.174861:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.174959:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945656704 00000100:00100000:3.0:1787387986.174970:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945656704 00000100:00100000:3.0:1787387986.175031:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945656448 00000100:00100000:3.0:1787387986.175035:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945656448 00000100:00100000:3.0:1787387986.175065:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787387986.175077:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945656704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.175163:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945656704:12345-0@lo:400:kworker.0 Request processed in 87us (11995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.175800:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787387986.175841:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787387986.175854:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945656448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.175937:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945656448:12345-0@lo:400:kworker.0 Request processed in 85us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.175946:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787387986.176003:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945656320 00000100:00100000:3.0:1787387986.176010:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945656320 00000100:00100000:3.0:1787387986.176051:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945656832 00000100:00100000:3.0:1787387986.176057:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945656832 00000100:00100000:3.0:1787387986.176085:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945657344 00000100:00100000:3.0:1787387986.176089:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945657344 00000100:00100000:3.0:1787387986.176102:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945656960 00000100:00100000:3.0:1787387986.176105:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945656960 00000100:00100000:3.0:1787387986.176118:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945657472 00000100:00100000:3.0:1787387986.176121:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945657472 00000100:00100000:3.0:1787387986.176140:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945656576 00000100:00100000:3.0:1787387986.176143:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945656576 00000100:00100000:3.0:1787387986.176159:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787387986.176164:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945656320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.176518:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945656320:12345-0@lo:400:kworker.0 Request processed in 352us (13333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.176527:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787387986.176549:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787387986.176558:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945656832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.176650:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945656832:12345-0@lo:400:kworker.0 Request processed in 94us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.176658:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787387986.176679:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787387986.176688:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945657344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.176877:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945657344:12345-0@lo:400:kworker.0 Request processed in 190us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.176884:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787387986.176897:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787387986.176903:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945656960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.176947:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945656960:12345-0@lo:400:kworker.0 Request processed in 45us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.176953:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787387986.176965:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787387986.176971:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945657472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.177008:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945657472:12345-0@lo:400:kworker.0 Request processed in 37us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.177015:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787387986.177030:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787387986.177038:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945656576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.177071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945656576:12345-0@lo:400:kworker.0 Request processed in 34us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.177078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787387986.177128:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945657088 00000100:00100000:3.0:1787387986.177135:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945657088 00000100:00100000:3.0:1787387986.177456:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787387986.177472:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945657088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387986.177563:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387986.177882:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945657088:12345-0@lo:400:kworker.0 Request processed in 417us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.177890:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787387986.182416:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945656704:0@lo:400:kworker.0 00000100:00100000:2.0:1787387986.182465:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945656192 00000100:00100000:3.0:1787387986.182466:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945657216 00000100:00100000:2.0:1787387986.182474:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945656192 00000100:00100000:3.0:1787387986.182481:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945657216 00000100:00100000:2.0:1787387986.182559:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787387986.182565:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787387986.182574:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945656192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.182583:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945657216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387986.182676:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945656192:12345-0@lo:400:kworker.0 Request processed in 104us (19611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387986.182687:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787387986.182691:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945657216:12345-0@lo:400:kworker.0 Request processed in 113us (5131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387986.182719:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787387986.182765:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787387986.182772:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787387986.182775:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787387986.182829:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945656576:0@lo:400:kworker.0 00010000:00080000:2.0:1787387986.182859:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d98380 x1874211945657216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787387986.182861:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d98a80 x1874211945657088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387986.182910:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945657216:0@lo:400:kworker.0 00000100:00100000:2.0:1787387986.182924:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945656192:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.183618:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945657088:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.183646:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945656448:0@lo:400:kworker.0 00010000:00080000:3.0:1787387986.183662:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9a300 x1874211945656960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387986.183672:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945656960:0@lo:400:kworker.0 00010000:00080000:3.0:1787387986.183685:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9ad80 x1874211945657472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387986.183695:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945657472:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.183780:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945656320:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.183796:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945656832:0@lo:400:kworker.0 00000100:00100000:3.0:1787387986.183813:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945657344:0@lo:400:kworker.0 00000001:02000400:2.0:1787387986.395166:0:10940:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing yml_node 00010000:00010000:0.0:1787387986.552328:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787387987.180642:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945657600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787387987.180711:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387987.180896:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945657600 00000100:00100000:1.0:1787387987.180905:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945657600 00000100:00100000:1.0:1787387987.180956:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787387987.180965:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945657600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787387987.180995:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787387987.181043:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945657600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387987.181050:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787387987.181179:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945657600:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1787387987.182110:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:2.0:1787387987.182115:0:9514:0:(genops.c:906:class_export_put()) final put ffff996a42d84800/00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:3.0:1787387987.182192:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42d84800/00e97fed-41ea-4716-be07-f037d23906cf for lustre-OST0001 00000020:00000080:3.0:1787387987.182226:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a42d86000 for lustre-OST0001 00000100:00100000:3.0:1787387987.204283:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387987.204331:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387987.204543:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387987.204569:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925665024 00000100:00100000:3.0:1787387987.204577:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925665024 00000100:00100000:3.0:1787387987.204625:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925664896 00000100:00100000:3.0:1787387987.204629:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925664896 00000100:00100000:3.0:1787387987.204652:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 101 00000100:00100000:3.0:1787387987.204662:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925665024:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787387987.204728:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925665024:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 67us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.204746:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 101 00000100:00100000:3.0:1787387987.204761:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 102 00000100:00100000:3.0:1787387987.204767:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925664896:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787387987.205202:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925664896:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 433us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387987.205209:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 102 00000100:00080000:3.0:1787387987.205229:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787387987.205233:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787387987.205591:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925664768 00000100:00100000:0.0:1787387987.205596:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925664768 00000100:00100000:0.0:1787387987.205631:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 284 00000100:00100000:0.0:1787387987.205637:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2401:x1874211925664768:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787387987.205660:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2401:x1874211925664768:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387987.205665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 284 00010000:00010000:1.0:1787387987.564585:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787387987.699333:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:1.0:1787387987.699343:0:8430:0:(genops.c:906:class_export_put()) final put ffff996a42d86800/00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:0.0:1787387987.699528:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42d86800/00e97fed-41ea-4716-be07-f037d23906cf for lustre-OST0000 00000020:00000080:0.0:1787387987.699665:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a42d83800 for lustre-OST0000 00000100:00100000:3.0:1787387988.204777:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945657728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787387988.204847:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387988.205045:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945657728 00000100:00100000:0.0:1787387988.205066:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945657728 00000100:00100000:0.0:1787387988.205146:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787387988.205157:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945657728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787387988.205191:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787387988.205242:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945657728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387988.205249:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787387988.205389:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787387988.205434:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43909c00 x1874211945657728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387988.205466:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945657728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787387988.208102:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945657856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787387988.208181:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387988.208282:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945657856 00000100:00100000:2.0:1787387988.208290:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945657856 00000100:00100000:2.0:1787387988.208390:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787387988.208402:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945657856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387988.208426:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787387988.208654:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387988.208802:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945657856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 401us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387988.208810:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787387988.208936:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a15180 x1874211945657856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387988.208954:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945657856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787387988.588640:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787387989.615174:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387990.253929:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945657984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787387990.253999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387990.254149:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945657984 00000100:00100000:3.0:1787387990.254157:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945657984 00000100:00100000:3.0:1787387990.254212:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787387990.254222:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945657984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787387990.254254:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787387990.254307:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945657984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387990.254314:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787387990.254456:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945657984:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787387990.637220:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787387991.132975:0:11124:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.111 00000100:00100000:1.0:1787387991.278443:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945658112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787387991.278512:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387991.278571:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945658112 00000100:00100000:3.0:1787387991.278580:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945658112 00000100:00100000:3.0:1787387991.278632:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787387991.278643:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945658112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787387991.278669:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387991.278723:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945658112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387991.278730:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787387991.278749:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787387991.278778:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a15500 x1874211945658112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387991.278794:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945658112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387991.280437:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945658240:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.280580:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.280614:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945658752:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.280644:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.280662:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945659264:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.280683:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.280703:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787387991.280719:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945658368:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.280752:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.280770:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945658880:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.280791:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.280806:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945659392:0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.280918:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945659264 00000100:00100000:3.0:1787387991.280925:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945659264 00000100:00100000:3.0:1787387991.280984:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787387991.280999:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945659264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387991.281044:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945659264:12345-0@lo:400:kworker.0 Request processed in 45us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387991.281051:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787387991.281073:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387991.282046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787387991.282094:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f588380 x1874211945659264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387991.282108:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945659264:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.282128:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945659776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787387991.282156:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387991.282231:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945658368 00000100:00100000:0.0:1787387991.282238:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945658368 00000100:00100000:0.0:1787387991.282273:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945658880 00000100:00100000:0.0:1787387991.282277:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945658880 00000100:00100000:0.0:1787387991.282296:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945659392 00000100:00100000:0.0:1787387991.282299:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945659392 00000100:00100000:0.0:1787387991.282313:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787387991.282321:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945658368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387991.282381:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945658368:12345-0@lo:400:kworker.0 Request processed in 60us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387991.282389:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787387991.282404:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787387991.282410:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945658880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387991.282439:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945658880:12345-0@lo:400:kworker.0 Request processed in 29us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387991.282445:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787387991.282456:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787387991.282471:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945659392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787387991.282499:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945659392:12345-0@lo:400:kworker.0 Request processed in 29us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387991.282505:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1787387991.282525:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387991.285597:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945658496:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.285664:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.285713:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945659008:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.285740:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387991.285751:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945658752 00000100:00100000:1.0:1787387991.285760:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945658752 00000100:00100000:2.0:1787387991.285763:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945659520:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.285789:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387991.285808:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945658496 00000100:00100000:2.0:1787387991.285812:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787387991.285813:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945658496 00000100:00100000:1.0:1787387991.285834:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787387991.285842:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945658752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.285900:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945658624:0@lo:400:kworker.0 00000100:00100000:1.0:1787387991.285936:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945658752:12345-0@lo:400:kworker.0 Request processed in 93us (5289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387991.285943:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787387991.285963:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787387991.285969:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945658496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387991.287743:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945658496:12345-0@lo:400:kworker.0 Request processed in 1766us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387991.287755:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787387991.288777:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.288912:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945659136:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.289059:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.289084:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945659648:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.289105:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387991.289156:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945658496:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.289201:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945658240 00000100:00100000:2.0:1787387991.289207:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945658240 00000100:00100000:2.0:1787387991.289322:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787387991.289331:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945658240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.289394:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945658240:12345-0@lo:400:kworker.0 Request processed in 64us (8814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387991.289400:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787387991.289436:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945659008 00000100:00100000:2.0:1787387991.289440:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945659008 00000100:00100000:2.0:1787387991.289472:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945659520 00000100:00100000:2.0:1787387991.289475:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945659520 00000100:00100000:2.0:1787387991.289636:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945658624 00000100:00100000:2.0:1787387991.289641:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945658624 00000100:00100000:2.0:1787387991.289656:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787387991.289661:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945659008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.289760:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945659008:12345-0@lo:400:kworker.0 Request processed in 98us (4019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387991.289766:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787387991.289780:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787387991.289787:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945659520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.289824:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945659520:12345-0@lo:400:kworker.0 Request processed in 30us (4027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387991.289831:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787387991.289842:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787387991.289850:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945658624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.289877:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945658624:12345-0@lo:400:kworker.0 Request processed in 29us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387991.289891:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787387991.289915:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945659776 00000100:00100000:2.0:1787387991.289919:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945659776 00000100:00100000:2.0:1787387991.290074:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787387991.290083:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945659776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787387991.290099:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387991.290129:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945659776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (7972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387991.290134:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1787387991.290152:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787387991.290156:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787387991.290189:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4390bb80 x1874211945659776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387991.290207:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945659776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787387991.290300:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945658368:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.290317:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945658880:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.290329:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945659392:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.290338:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945658240:0@lo:400:kworker.0 00000100:00100000:2.0:1787387991.290368:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945658752:0@lo:400:kworker.0 00000100:00100000:1.0:1787387991.290953:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945659136 00000100:00100000:1.0:1787387991.290968:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945659136 00000100:00100000:1.0:1787387991.291022:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945659648 00000100:00100000:1.0:1787387991.291026:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945659648 00000100:00100000:1.0:1787387991.291047:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787387991.291055:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945659136:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787387991.291060:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387991.291106:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945659136:12345-0@lo:400:kworker.0 Request processed in 51us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387991.291114:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787387991.291121:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d98a80 x1874211945659008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787387991.291132:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787387991.291135:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945659008:0@lo:400:kworker.0 00000100:00100000:1.0:1787387991.291142:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945659648:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787387991.291154:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58b480 x1874211945659520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387991.291169:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945659520:0@lo:400:kworker.0 00000100:00100000:1.0:1787387991.291179:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945659648:12345-0@lo:400:kworker.0 Request processed in 39us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387991.291186:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787387991.291198:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945658624:0@lo:400:kworker.0 00010000:00080000:3.0:1787387991.291211:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d98380 x1874211945659136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387991.291475:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945659136:0@lo:400:kworker.0 00010000:00080000:3.0:1787387991.291554:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f589180 x1874211945659648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787387991.291564:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945659648:0@lo:400:kworker.0 00010000:00010000:1.0:1787387991.662156:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787387992.300626:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787387992.300648:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945659904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787387992.300731:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387992.300915:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945659904 00000100:00100000:3.0:1787387992.300923:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945659904 00000100:00100000:3.0:1787387992.300977:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787387992.300986:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945659904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787387992.301017:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787387992.301077:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945659904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387992.301085:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787387992.301194:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945659904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787387992.322888:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387992.322930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787387992.322962:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387992.323459:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925665152 00000100:00100000:0.0:1787387992.323469:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925665152 00000100:00100000:0.0:1787387992.323597:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 286 00000100:00100000:0.0:1787387992.323606:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925665152:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787387992.323675:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925665152:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 70us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787387992.323683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 286 00000100:00100000:2.0:1787387992.323736:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925665408 00000100:00100000:2.0:1787387992.323741:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925665408 00000100:00100000:2.0:1787387992.323775:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925665280 00000100:00100000:2.0:1787387992.323779:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925665280 00000100:00100000:2.0:1787387992.323805:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 109 00000100:00100000:2.0:1787387992.323812:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925665408:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787387992.323844:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925665408:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 32us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387992.323851:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 109 00000100:00100000:2.0:1787387992.323864:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 110 00000100:00100000:2.0:1787387992.323870:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925665280:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787387992.323893:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925665280:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387992.323899:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 110 00000100:00080000:2.0:1787387992.323917:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787387992.323921:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787387992.684877:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387993.325488:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945660032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787387993.325557:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387993.325616:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787387993.325623:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945660160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787387993.325645:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387993.326072:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945660032 00000100:00100000:2.0:1787387993.326081:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945660032 00000100:00100000:2.0:1787387993.326141:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945660160 00000100:00100000:2.0:1787387993.326145:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945660160 00000100:00100000:2.0:1787387993.326167:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787387993.326175:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945660032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787387993.326204:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387993.326257:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945660032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387993.326282:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787387993.326301:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787387993.326308:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945660160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787387993.326319:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787387993.326441:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787387993.326592:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945660160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 285us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387993.326598:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787387993.326634:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43909c00 x1874211945660160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387993.326653:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945660160:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787387993.326665:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a16300 x1874211945660032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387993.327437:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945660032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787387993.708634:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787387994.070570:0:11221:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.111 00010000:00010000:1.0:1787387994.735630:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387995.373640:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787387995.373663:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945660288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787387995.373742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387995.373914:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945660288 00000100:00100000:3.0:1787387995.373921:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945660288 00000100:00100000:3.0:1787387995.373975:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787387995.373994:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945660288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787387995.374026:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787387995.374082:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945660288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387995.374089:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787387995.374201:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945660288:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787387995.758683:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387996.396520:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945660416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787387996.396594:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787387996.396685:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945660416 00000100:00100000:3.0:1787387996.396694:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945660416 00000100:00100000:3.0:1787387996.396762:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787387996.396775:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945660416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787387996.396807:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787387996.396862:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945660416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387996.396869:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787387996.397011:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a15500 x1874211945660416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387996.397031:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945660416:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787387996.397036:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787387996.397055:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945661056:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.397086:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.397123:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945661568:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.397150:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.397165:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945662080:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.397183:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.397208:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787387996.397214:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945660672:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.397286:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945661568 00000100:00100000:1.0:1787387996.397294:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945661568 00000100:00100000:1.0:1787387996.397332:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945662080 00000100:00100000:1.0:1787387996.397335:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945662080 00000100:00100000:1.0:1787387996.397380:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787387996.397388:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945661568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.397427:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945661568:12345-0@lo:400:kworker.0 Request processed in 40us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.397433:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787387996.397457:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787387996.397463:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945662080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.397487:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945662080:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.397493:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1787387996.397506:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787387996.397508:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787387996.397744:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945661056 00000100:00100000:3.0:1787387996.397750:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945661056 00000100:00100000:3.0:1787387996.397786:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787387996.397793:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945661056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387996.397828:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945661056:12345-0@lo:400:kworker.0 Request processed in 35us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387996.397853:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787387996.398337:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.398380:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945661184:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.398409:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.398428:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945661696:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.398561:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.398583:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945662208:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.398607:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.398933:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945661056:0@lo:400:kworker.0 00010000:00080000:2.0:1787387996.398950:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43006680 x1874211945661568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387996.398960:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945661568:0@lo:400:kworker.0 00010000:00080000:2.0:1787387996.398969:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43007800 x1874211945662080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387996.398978:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945662080:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.399010:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945660544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787387996.399038:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.399058:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945660928:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.399091:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.399110:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945661440:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.399131:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.399148:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945661952:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.399167:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.399186:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787387996.399192:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945660800:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.399213:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.399228:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945661312:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.399734:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945661440 00000100:00100000:1.0:1787387996.399741:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945661440 00000100:00100000:1.0:1787387996.399777:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945661952 00000100:00100000:1.0:1787387996.399780:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945661952 00000100:00100000:1.0:1787387996.399794:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945660800 00000100:00100000:1.0:1787387996.399796:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945660800 00000100:00100000:1.0:1787387996.399809:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787387996.399816:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945661440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.399872:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945661440:12345-0@lo:400:kworker.0 Request processed in 56us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.399879:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787387996.399899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787387996.399905:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945661952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.399933:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945661952:12345-0@lo:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.399939:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787387996.399949:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787387996.399955:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945660800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.399983:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945660800:12345-0@lo:400:kworker.0 Request processed in 28us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.399990:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787387996.399999:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945660672 00000100:00100000:3.0:1787387996.400006:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945660672 00000100:00080000:1.0:1787387996.400012:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787387996.400039:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787387996.400047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945660672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787387996.400094:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945660672:12345-0@lo:400:kworker.0 Request processed in 49us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787387996.400100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787387996.400577:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945660672:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.400929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387996.400962:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945661824:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.400991:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787387996.401013:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58d180 x1874211945661440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387996.401024:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945661440:0@lo:400:kworker.0 00010000:00080000:2.0:1787387996.401035:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43007b80 x1874211945661952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387996.401043:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945661952:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.401062:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945660800:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.401093:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945660544 00000100:00100000:2.0:1787387996.401097:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945660544 00000100:00100000:2.0:1787387996.401126:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787387996.401133:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945660544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787387996.401160:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787387996.401198:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945660544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.401205:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787387996.401225:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945661696 00000100:00100000:2.0:1787387996.401229:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945661696 00000100:00080000:1.0:1787387996.402437:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787387996.402467:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945661312 00000100:00100000:1.0:1787387996.402475:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945661312 00000100:00100000:1.0:1787387996.402513:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945661824 00000100:00100000:1.0:1787387996.402517:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945661824 00000100:00100000:1.0:1787387996.402536:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787387996.402544:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945661312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.402610:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945661312:12345-0@lo:400:kworker.0 Request processed in 66us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387996.402617:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787387996.402631:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787387996.402638:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945661824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.402665:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945661824:12345-0@lo:400:kworker.0 Request processed in 28us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.402810:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945662208 00000100:00100000:2.0:1787387996.402814:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945662208 00000100:00100000:2.0:1787387996.402827:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787387996.402832:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945661696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.402873:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945661696:12345-0@lo:400:kworker.0 Request processed in 40us (4425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.402878:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787387996.402890:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787387996.402897:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945662208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.402923:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945662208:12345-0@lo:400:kworker.0 Request processed in 28us (4316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.402928:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787387996.402956:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945661184 00000100:00100000:2.0:1787387996.402960:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945661184 00000100:00080000:0.0:1787387996.402976:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787387996.402980:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945660928 00000100:00100000:2.0:1787387996.402984:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945660928 00000100:00100000:2.0:1787387996.403004:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787387996.403011:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945661184:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787387996.403020:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43006d80 x1874211945661696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387996.403037:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945661696:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.403046:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945661184:12345-0@lo:400:kworker.0 Request processed in 34us (4633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.403053:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1787387996.403056:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43007100 x1874211945662208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387996.403070:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945662208:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.403082:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787387996.403109:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945661184:0@lo:400:kworker.0 00000100:00100000:1.0:1787387996.403248:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787387996.404267:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945660928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.404338:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945660928:12345-0@lo:400:kworker.0 Request processed in 82us (5245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387996.404358:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787387996.404440:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945661312:0@lo:400:kworker.0 00000100:00100000:2.0:1787387996.404462:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945661824:0@lo:400:kworker.0 00010000:00080000:2.0:1787387996.404476:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311e680 x1874211945660544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387996.404494:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945660544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787387996.404505:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945660928:0@lo:400:kworker.0 00010000:00010000:0.0:1787387996.780531:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787387997.036074:0:11319:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.111 00000100:00100000:0.0:1787387997.420596:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787387997.420630:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945662336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787387997.420740:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787387997.421099:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945662336 00000100:00100000:2.0:1787387997.421110:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945662336 00000100:00100000:2.0:1787387997.421189:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787387997.421202:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945662336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787387997.421246:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787387997.421308:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945662336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387997.421316:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787387997.421341:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945662336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787387997.441506:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387997.441634:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925665664 00000100:00100000:1.0:1787387997.441647:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925665664 00000100:00100000:1.0:1787387997.441744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:1.0:1787387997.441757:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925665664:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787387997.441859:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925665664:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 106us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387997.441868:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00080000:0.0:1787387997.441945:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787387997.452850:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787387997.452914:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787387997.453052:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925665792 00000100:00100000:1.0:1787387997.453065:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925665792 00000100:00100000:1.0:1787387997.453161:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:1.0:1787387997.453175:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925665792:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787387997.453278:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925665792:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 107us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387997.453287:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:2.0:1787387997.453553:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925665536 00000100:00100000:2.0:1787387997.453560:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925665536 00000100:00100000:2.0:1787387997.453606:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 288 00000100:00100000:2.0:1787387997.453615:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+10:2401:x1874211925665536:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787387997.453648:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+10:2401:x1874211925665536:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 35us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787387997.453686:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 288 00000100:00080000:0.0:1787387997.453770:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787387997.805737:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787387998.445772:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945662464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787387998.446743:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787387998.447389:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945662592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787387998.448089:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787387998.448407:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945662464 00000100:00100000:1.0:1787387998.448419:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945662464 00000100:00100000:1.0:1787387998.448648:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945662592 00000100:00100000:1.0:1787387998.448673:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945662592 00000100:00100000:1.0:1787387998.448703:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787387998.448714:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945662464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787387998.448746:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387998.448919:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945662464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 206us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387998.448927:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787387998.448963:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787387998.448969:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945662592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787387998.448980:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787387998.449012:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945662592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787387998.449017:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787387998.449497:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787387998.449765:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43909c00 x1874211945662464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787387998.449786:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945662464:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787387998.450017:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a14e00 x1874211945662592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787387998.450042:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945662592:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787387998.677335:0:11367:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 04:39:57 EDT 2026 00010000:00010000:0.0:1787387998.831430:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787387999.868626:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388000.498115:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945662720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388000.498193:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388000.498318:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945662720 00000100:00100000:2.0:1787388000.498326:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945662720 00000100:00100000:2.0:1787388000.498406:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787388000.498414:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945662720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388000.498448:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388000.498498:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945662720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388000.498505:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787388000.500106:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945662720:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388000.879812:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388001.526488:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945662848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388001.526566:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.526648:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945662976:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.526680:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388001.526899:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945663104:0@lo:400:kworker.0 00000100:00100000:0.0:1787388001.526931:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388001.526954:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945663616:0@lo:400:kworker.0 00000100:00100000:0.0:1787388001.526974:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388001.526990:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a422a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945664128:0@lo:400:kworker.0 00000100:00100000:0.0:1787388001.527010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388001.527039:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787388001.527045:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945663232:0@lo:400:kworker.0 00000100:00100000:0.0:1787388001.527066:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388001.527083:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945663744:0@lo:400:kworker.0 00000100:00100000:0.0:1787388001.527102:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.542052:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945663488:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.542164:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.542196:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a422a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945664000:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.542224:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.542243:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945664512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388001.542266:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.545497:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787388001.545513:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945663232 00000100:00100000:2.0:1787388001.545524:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945663232 00000100:00100000:1.0:1787388001.545568:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945662848 00000100:00100000:1.0:1787388001.545573:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945662848 00000100:00100000:1.0:1787388001.545620:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945664512 00000100:00100000:1.0:1787388001.545632:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945664512 00000100:00100000:1.0:1787388001.545668:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787388001.545672:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945663488 00000100:00100000:2.0:1787388001.545677:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945663488 00000100:00100000:1.0:1787388001.545679:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945662848:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388001.545700:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787388001.545710:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945663232:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787388001.545781:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388001.545787:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945663232:12345-0@lo:400:kworker.0 Request processed in 77us (18717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388001.545797:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787388001.545826:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945662848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 148us (19268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.545833:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787388001.545848:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787388001.545855:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945664512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388001.545864:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388001.545888:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945664512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.545893:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787388001.545920:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787388001.545929:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945663488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388001.545955:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a422aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945664256:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.545967:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945663488:12345-0@lo:400:kworker.0 Request processed in 39us (3804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.545974:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787388001.546003:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388001.546035:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945663232:0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.546104:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945663104 00000100:00100000:2.0:1787388001.546115:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945663104 00000100:00100000:2.0:1787388001.546135:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945663616 00000100:00100000:2.0:1787388001.546138:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945663616 00000100:00100000:2.0:1787388001.546151:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945664128 00000100:00100000:2.0:1787388001.546154:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945664128 00000100:00100000:2.0:1787388001.546166:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945663744 00000100:00100000:2.0:1787388001.546168:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945663744 00000100:00100000:2.0:1787388001.546180:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945664256 00000100:00100000:2.0:1787388001.546182:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945664256 00000100:00100000:2.0:1787388001.546196:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787388001.546202:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945663104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.546287:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945663104:12345-0@lo:400:kworker.0 Request processed in 84us (19354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388001.546293:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787388001.546360:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945662976 00000100:00100000:3.0:1787388001.546364:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945662976 00000100:00100000:3.0:1787388001.546381:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787388001.546388:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945663616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388001.546431:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945663616:12345-0@lo:400:kworker.0 Request processed in 44us (19455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388001.546436:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787388001.546842:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945664000 00000100:00100000:1.0:1787388001.546848:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945664000 00000100:00100000:1.0:1787388001.546884:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787388001.546892:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945664000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.546930:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945664000:12345-0@lo:400:kworker.0 Request processed in 40us (4706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.546937:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787388001.547082:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787388001.547091:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945664128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.547126:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945664128:12345-0@lo:400:kworker.0 Request processed in 37us (20114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388001.547131:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787388001.547143:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787388001.547149:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945663744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.547182:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945663744:12345-0@lo:400:kworker.0 Request processed in 34us (20078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388001.547188:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787388001.547199:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787388001.547207:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945664256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.547236:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945664256:12345-0@lo:400:kworker.0 Request processed in 32us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388001.547250:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1787388001.547304:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43007480 x1874211945662848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388001.547322:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945662848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388001.547407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00080000:1.0:1787388001.548924:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388001.548944:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388001.548946:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388001.548949:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388001.550385:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945662976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388001.550534:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945662976:12345-0@lo:400:kworker.0 Request processed in 3119us (23852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388001.550543:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787388001.553042:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945663360:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.553113:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.553154:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945663360 00000100:00100000:1.0:1787388001.553162:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945663360 00000100:00100000:1.0:1787388001.553207:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787388001.553216:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945663360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.553264:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945663360:12345-0@lo:400:kworker.0 Request processed in 49us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.553270:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787388001.553325:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945663360:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.553333:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945663872:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.553385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.553406:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945663872 00000100:00100000:1.0:1787388001.553411:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945663872 00000100:00100000:1.0:1787388001.553444:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787388001.553452:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945663872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.553483:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945663872:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.553489:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787388001.553504:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787388001.553525:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c56a00 x1874211945663872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388001.553537:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945663872:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.553561:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a422a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945664384:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.553585:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388001.553604:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945664384 00000100:00100000:1.0:1787388001.553608:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945664384 00000100:00100000:1.0:1787388001.553630:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787388001.553648:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945664384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.553678:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945664384:12345-0@lo:400:kworker.0 Request processed in 41us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388001.553683:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787388001.553709:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a422a8a80 x1874211945664384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388001.557506:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945663104:0@lo:400:kworker.0 00000100:00100000:0.0:1787388001.557536:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945663616:0@lo:400:kworker.0 00000100:00100000:0.0:1787388001.557548:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a422a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945664128:0@lo:400:kworker.0 00010000:00080000:0.0:1787388001.557582:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c54380 x1874211945663744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388001.557594:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945663744:0@lo:400:kworker.0 00010000:00080000:0.0:1787388001.557606:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a422aa300 x1874211945664256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388001.557614:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a422aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945664256:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.558104:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a422a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945664384:0@lo:400:kworker.0 00000100:00100000:1.0:1787388001.558126:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945663488:0@lo:400:kworker.0 00010000:00080000:1.0:1787388001.558139:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a422a9f80 x1874211945664000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388001.558148:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a422a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945664000:0@lo:400:kworker.0 00010000:00080000:1.0:1787388001.558162:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a16300 x1874211945664512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388001.558178:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945664512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388001.558189:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945662976:0@lo:400:kworker.0 00010000:00010000:2.0:1787388001.901293:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388002.540783:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945664640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388002.540864:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388002.541148:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945664640 00000100:00100000:3.0:1787388002.541157:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945664640 00000100:00100000:3.0:1787388002.541211:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787388002.541220:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945664640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388002.541251:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388002.541304:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945664640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388002.541312:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787388002.541551:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945664640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388002.562938:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388002.562987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388002.563285:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388002.563381:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925666176 00000100:00100000:3.0:1787388002.563390:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925666176 00000100:00100000:3.0:1787388002.563460:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925666048 00000100:00100000:3.0:1787388002.563464:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925666048 00000100:00100000:2.0:1787388002.563481:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:3.0:1787388002.563486:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:2.0:1787388002.563492:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925666176:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388002.563493:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925666048:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388002.563556:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925666048:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 63us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388002.563564:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:1.0:1787388002.563570:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925665920 00000100:00100000:1.0:1787388002.563574:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925665920 00000100:00100000:1.0:1787388002.563603:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 290 00000100:00100000:1.0:1787388002.563617:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925665920:12345-192.168.203.15@tcp:400:kworker.0 00000100:00080000:0.0:1787388002.563671:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388002.563682:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388002.567618:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925666176:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 4118us (4620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388002.568404:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2402:x1874211925665920:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 4783us (5470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388002.568415:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 290 00000100:00100000:2.0:1787388002.568575:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 125 00010000:00010000:1.0:1787388002.930682:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388003.564558:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945664768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388003.564640:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388003.564779:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945664768 00000100:00100000:3.0:1787388003.564787:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945664768 00000100:00100000:3.0:1787388003.564846:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787388003.564855:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945664768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388003.564882:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388003.564924:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945664768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388003.564930:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787388003.565106:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787388003.565137:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a14e00 x1874211945664768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388003.565155:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945664768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388003.565482:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a422ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945664896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388003.565519:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388003.565603:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945664896 00000100:00100000:0.0:1787388003.565608:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945664896 00000100:00100000:0.0:1787388003.565664:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787388003.565672:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945664896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388003.565684:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388003.565720:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945664896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388003.565726:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787388003.565766:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a422ab480 x1874211945664896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388003.565779:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a422ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945664896:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787388003.565872:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787388003.952659:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388004.979253:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388005.619208:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945665024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388005.619286:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388005.619508:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945665024 00000100:00100000:3.0:1787388005.619516:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945665024 00000100:00100000:3.0:1787388005.619568:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787388005.619577:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b62293850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945665024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388005.619618:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388005.619669:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b62293850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945665024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388005.619676:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787388005.619966:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945665024:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787388005.996554:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388006.645959:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945665152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388006.646056:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.646150:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945665152 00000100:00100000:3.0:1787388006.646160:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945665152 00000100:00100000:3.0:1787388006.646226:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787388006.646238:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945665152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388006.646274:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388006.646325:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945665152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.646332:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787388006.646373:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787388006.646422:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a14e00 x1874211945665152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388006.646443:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945665152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388006.657056:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945665536:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.657216:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.657307:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945666048:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.657397:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.657424:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945666560:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.657447:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.657490:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787388006.657498:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945665408:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.657558:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.657595:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945665920:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.659377:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.659438:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945666432:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.659762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.659823:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945665536 00000100:00100000:3.0:1787388006.659831:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945665536 00000100:00100000:3.0:1787388006.659881:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945666048 00000100:00100000:3.0:1787388006.659885:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945666048 00000100:00100000:3.0:1787388006.659908:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945666560 00000100:00100000:3.0:1787388006.659912:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945666560 00000100:00100000:3.0:1787388006.659930:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787388006.659938:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945665536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.659997:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945665536:12345-0@lo:400:kworker.0 Request processed in 59us (2782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.660004:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787388006.660020:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787388006.660026:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945666048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.660054:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945666048:12345-0@lo:400:kworker.0 Request processed in 29us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.660061:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787388006.660072:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787388006.660078:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945666560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.660105:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945666560:12345-0@lo:400:kworker.0 Request processed in 27us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.660110:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787388006.660132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945665408 00000100:00100000:3.0:1787388006.660135:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945665408 00000100:00100000:3.0:1787388006.660156:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787388006.660176:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945665408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.660207:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945665408:12345-0@lo:400:kworker.0 Request processed in 32us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.660213:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787388006.660342:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945665920 00000100:00100000:3.0:1787388006.660368:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945665920 00000100:00100000:3.0:1787388006.660396:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787388006.660403:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945665920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.660435:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945665920:12345-0@lo:400:kworker.0 Request processed in 33us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.660440:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787388006.660466:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a422ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945665280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388006.660563:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.660583:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945665792:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.660616:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.660769:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945666304:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.660794:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.660813:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945666816:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.660832:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.660854:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787388006.660861:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945665664:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.660882:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.660896:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945666176:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.660916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.660929:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945666688:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.660957:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388006.660981:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945666432 00000100:00100000:3.0:1787388006.660984:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945666432 00000100:00100000:3.0:1787388006.661009:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945666304 00000100:00100000:3.0:1787388006.661011:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945666304 00000100:00100000:3.0:1787388006.661023:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945666816 00000100:00100000:3.0:1787388006.661026:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945666816 00000100:00100000:3.0:1787388006.661041:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787388006.661046:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945666432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.661076:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945666432:12345-0@lo:400:kworker.0 Request processed in 29us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.661082:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787388006.661094:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787388006.661100:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945666304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.661128:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945666304:12345-0@lo:400:kworker.0 Request processed in 28us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.661134:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787388006.661145:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787388006.661150:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945666816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.661174:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945666816:12345-0@lo:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.661180:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787388006.661197:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945665792 00000100:00100000:3.0:1787388006.661200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945665792 00000100:00100000:3.0:1787388006.661214:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945666176 00000100:00100000:3.0:1787388006.661216:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945666176 00000100:00100000:3.0:1787388006.661226:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945666688 00000100:00100000:3.0:1787388006.661228:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945666688 00000100:00100000:3.0:1787388006.661424:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787388006.661430:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945665792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.661460:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945665792:12345-0@lo:400:kworker.0 Request processed in 31us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.661466:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787388006.661550:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787388006.661557:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945666176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.661587:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945666176:12345-0@lo:400:kworker.0 Request processed in 31us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.661593:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787388006.663572:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787388006.663591:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945666688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.663800:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945666688:12345-0@lo:400:kworker.0 Request processed in 216us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.663808:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787388006.663837:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388006.663842:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787388006.663844:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388006.663847:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388006.663865:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945665664 00000100:00100000:3.0:1787388006.663871:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945665664 00000100:00100000:3.0:1787388006.663898:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787388006.663903:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945665664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.663940:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945665664:12345-0@lo:400:kworker.0 Request processed in 36us (3057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388006.663946:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787388006.663999:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945665664:0@lo:400:kworker.0 00010000:00080000:3.0:1787388006.664032:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b72b5b100 x1874211945666176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388006.664044:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945666176:0@lo:400:kworker.0 00010000:00080000:3.0:1787388006.664056:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b72b58a80 x1874211945666688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388006.664064:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945666688:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.664075:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945665792:0@lo:400:kworker.0 00010000:00080000:3.0:1787388006.664086:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b72b58380 x1874211945666304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388006.664093:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945666304:0@lo:400:kworker.0 00010000:00080000:3.0:1787388006.664104:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b72b5a300 x1874211945666816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388006.664111:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945666816:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.664156:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945665408:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.664167:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945665920:0@lo:400:kworker.0 00010000:00080000:3.0:1787388006.664179:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b72b59c00 x1874211945666432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388006.664187:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945666432:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.664197:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945665536:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.664207:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945666048:0@lo:400:kworker.0 00000100:00100000:3.0:1787388006.664225:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945666560:0@lo:400:kworker.0 00000100:00100000:0.0:1787388006.665585:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945665280 00000100:00100000:0.0:1787388006.665629:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945665280 00000100:00100000:0.0:1787388006.665750:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787388006.665787:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945665280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388006.665825:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388006.666036:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945665280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 274us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388006.666045:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787388006.666150:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a422ab480 x1874211945665280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388006.666185:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a422ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945665280:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787388007.022984:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388007.661033:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945666944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388007.661126:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388007.661242:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945666944 00000100:00100000:1.0:1787388007.661251:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945666944 00000100:00100000:1.0:1787388007.661314:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787388007.661325:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945666944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388007.661391:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388007.663650:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945666944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2313us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388007.663667:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787388007.663765:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945666944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388007.686653:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388007.686700:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388007.686740:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388007.686783:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925666560 00000100:00100000:3.0:1787388007.686797:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925666560 00000100:00100000:3.0:1787388007.686880:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925666432 00000100:00100000:3.0:1787388007.686884:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925666432 00000100:00100000:3.0:1787388007.686916:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:3.0:1787388007.686931:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925666560:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388007.687028:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925666560:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 103us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388007.687036:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:3.0:1787388007.687055:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:3.0:1787388007.687062:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925666432:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388007.687089:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925666432:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388007.687097:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00080000:0.0:1787388007.687111:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388007.687117:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388007.687421:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925666304 00000100:00100000:2.0:1787388007.687427:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925666304 00000100:00100000:2.0:1787388007.687471:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 292 00000100:00100000:2.0:1787388007.687479:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2401:x1874211925666304:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388007.687518:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2401:x1874211925666304:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 40us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388007.687525:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 292 00010000:00010000:3.0:1787388008.044467:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388008.687975:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388008.688007:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945667072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388008.688100:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388008.688177:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945667072 00000100:00100000:2.0:1787388008.688185:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945667072 00000100:00100000:2.0:1787388008.688251:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787388008.688263:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945667072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388008.688300:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388008.688380:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945667072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388008.688388:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787388008.688414:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787388008.688452:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4390ad80 x1874211945667072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388008.688474:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945667072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388008.693127:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388008.693158:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945667200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388008.693251:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388008.693331:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945667200 00000100:00100000:3.0:1787388008.693340:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945667200 00000100:00100000:3.0:1787388008.693444:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787388008.693456:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945667200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388008.693488:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388008.693544:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945667200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388008.693566:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1787388008.693639:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b72b5aa00 x1874211945667200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388008.693662:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945667200:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787388008.695429:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787388009.074093:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388010.094727:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388010.732699:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945667328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388010.732807:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388010.733014:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945667328 00000100:00100000:1.0:1787388010.733025:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945667328 00000100:00100000:1.0:1787388010.733097:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787388010.733108:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945667328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388010.733153:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388010.733848:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945667328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 738us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388010.733857:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787388010.736656:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945667328:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388011.139022:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388011.764709:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388011.764729:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945667456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388011.764806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388011.764874:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945667456 00000100:00100000:1.0:1787388011.764881:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945667456 00000100:00100000:1.0:1787388011.764931:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787388011.764941:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945667456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388011.764969:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388011.765010:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945667456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388011.765017:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787388011.765037:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787388011.765065:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43004700 x1874211945667456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388011.765082:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945667456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388011.772510:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388011.772532:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945667584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388011.772613:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388011.772656:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945667584 00000100:00100000:1.0:1787388011.772662:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945667584 00000100:00100000:1.0:1787388011.772708:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787388011.772715:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945667584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388011.772751:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388011.772788:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945667584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388011.772795:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787388011.772813:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787388011.772838:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43004700 x1874211945667584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388011.772855:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945667584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388011.783144:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388011.783166:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945667712:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783242:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.783306:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945667840:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783332:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.783411:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945667968:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783439:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.783475:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388011.783481:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945668096:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783501:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.783527:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388011.783532:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945668224:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783550:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.783592:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945667968 00000100:00100000:2.0:1787388011.783600:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945667968 00000100:00100000:2.0:1787388011.783635:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945668224 00000100:00100000:2.0:1787388011.783637:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945668224 00000100:00100000:2.0:1787388011.783652:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787388011.783659:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945667968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783707:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945667968:12345-0@lo:400:kworker.0 Request processed in 47us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388011.783714:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787388011.783732:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787388011.783738:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945668224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783765:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945668224:12345-0@lo:400:kworker.0 Request processed in 28us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388011.783770:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787388011.783802:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945667968:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783837:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945668224:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783866:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945668352:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783889:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.783928:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945668480:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.783949:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.783984:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388011.783990:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945668608:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784012:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.784048:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388011.784054:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945668736:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784075:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.784109:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945668864:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784128:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.784167:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945668992:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388011.784233:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945667840 00000100:00100000:2.0:1787388011.784238:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945667840 00000100:00100000:2.0:1787388011.784257:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945668096 00000100:00100000:2.0:1787388011.784260:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945668096 00000100:00100000:2.0:1787388011.784269:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945668352 00000100:00100000:2.0:1787388011.784271:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945668352 00000100:00100000:2.0:1787388011.784291:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945668480 00000100:00100000:2.0:1787388011.784293:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945668480 00000100:00100000:2.0:1787388011.784305:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945668864 00000100:00100000:2.0:1787388011.784307:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945668864 00000100:00100000:2.0:1787388011.784319:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945668992 00000100:00100000:2.0:1787388011.784321:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945668992 00000100:00100000:2.0:1787388011.784368:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787388011.784374:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945667840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784413:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945667840:12345-0@lo:400:kworker.0 Request processed in 38us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388011.784419:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787388011.784432:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787388011.784438:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945668096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784466:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945668096:12345-0@lo:400:kworker.0 Request processed in 29us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388011.784472:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787388011.784482:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787388011.784488:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945668352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784512:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945668352:12345-0@lo:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388011.784519:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787388011.784528:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787388011.784533:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945668480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784556:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945668480:12345-0@lo:400:kworker.0 Request processed in 22us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388011.784562:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787388011.784587:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787388011.784593:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945668864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784618:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945668864:12345-0@lo:400:kworker.0 Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388011.784623:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787388011.784642:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787388011.784649:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945668992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784676:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945668992:12345-0@lo:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388011.784682:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1787388011.784709:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388011.784713:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787388011.784735:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b74f9f480 x1874211945668992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388011.784746:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945668992:0@lo:400:kworker.0 00010000:00080000:2.0:1787388011.784756:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7389f100 x1874211945668480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388011.784765:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945668480:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784775:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945668096:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784801:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945668864:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784810:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945668352:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784819:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945667840:0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784846:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945668608 00000100:00100000:2.0:1787388011.784850:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945668608 00000100:00100000:2.0:1787388011.784878:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945668736 00000100:00100000:2.0:1787388011.784881:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945668736 00000100:00100000:2.0:1787388011.784898:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787388011.784904:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945668608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.784936:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945668608:12345-0@lo:400:kworker.0 Request processed in 32us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388011.784947:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787388011.784960:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787388011.784967:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945668736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388011.785000:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945668736:12345-0@lo:400:kworker.0 Request processed in 34us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388011.785006:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787388011.785021:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787388011.785034:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7389c700 x1874211945668608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388011.785042:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945668608:0@lo:400:kworker.0 00010000:00080000:2.0:1787388011.785061:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b74f9f800 x1874211945668736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388011.785068:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945668736:0@lo:400:kworker.0 00000100:00100000:0.0:1787388011.785636:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945667712 00000100:00100000:0.0:1787388011.785643:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945667712 00000100:00100000:0.0:1787388011.785674:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787388011.785681:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945667712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388011.785793:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945667712:12345-0@lo:400:kworker.0 Request processed in 111us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388011.785800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787388011.785851:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945667712:0@lo:400:kworker.0 00010000:00010000:2.0:1787388012.143894:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388012.783549:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a422aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945669120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388012.783628:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388012.783714:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945669120 00000100:00100000:0.0:1787388012.783721:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945669120 00000100:00100000:0.0:1787388012.783769:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787388012.783777:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945669120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388012.783816:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388012.783859:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945669120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388012.783865:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787388012.783913:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a422aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945669120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388012.801325:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388012.801411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388012.801506:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388012.801549:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925666816 00000100:00100000:0.0:1787388012.801551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925666944 00000100:00100000:0.0:1787388012.801579:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925666944 00000100:00100000:2.0:1787388012.801580:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925666816 00000100:00100000:2.0:1787388012.801670:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:3.0:1787388012.801676:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925666688 00000100:00100000:3.0:1787388012.801684:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925666688 00000100:00100000:2.0:1787388012.801685:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2399:x1874211925666816:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388012.801771:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2399:x1874211925666816:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 91us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388012.801778:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:3.0:1787388012.801902:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 294 00000100:00100000:3.0:1787388012.801913:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:2399:x1874211925666688:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388012.801971:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+10:2399:x1874211925666688:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 60us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388012.801978:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 294 00000100:00100000:0.0:1787388012.802793:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:0.0:1787388012.802807:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925666944:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388012.802859:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925666944:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 57us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388012.802865:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00080000:2.0:1787388012.814600:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388012.814671:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787388013.164570:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388013.804773:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388013.804795:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945669248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388013.804862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388013.805182:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945669248 00000100:00100000:3.0:1787388013.805190:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945669248 00000100:00100000:3.0:1787388013.805254:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787388013.805263:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945669248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388013.805290:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388013.805341:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945669248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388013.805373:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787388013.805411:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b72b5a300 x1874211945669248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388013.805428:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945669248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388013.805910:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388013.805920:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945669376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388013.805954:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388013.805988:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945669376 00000100:00100000:3.0:1787388013.805993:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945669376 00000100:00100000:3.0:1787388013.806019:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787388013.806026:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945669376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388013.806039:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388013.806069:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945669376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388013.806076:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1787388013.806101:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b72b5a300 x1874211945669376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388013.806113:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945669376:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787388013.806599:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787388014.189494:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388015.212661:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388015.853636:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388015.853658:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945669504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388015.853739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388015.853968:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945669504 00000100:00100000:2.0:1787388015.853976:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945669504 00000100:00100000:2.0:1787388015.854044:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787388015.854054:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945669504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388015.854102:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388015.854156:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945669504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388015.854163:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787388015.854400:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945669504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787388016.238881:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388016.877942:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945669632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388016.878013:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388016.878072:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945669760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388016.878115:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388016.878150:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945670272:0@lo:400:kworker.0 00000100:00100000:2.0:1787388016.878169:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945670144:0@lo:400:kworker.0 00000100:00100000:1.0:1787388016.878180:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388016.878205:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388016.878227:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945670656:0@lo:400:kworker.0 00000100:00100000:2.0:1787388016.878263:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945670144 00000100:00100000:2.0:1787388016.878269:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945670144 00000100:00100000:2.0:1787388016.878311:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787388016.878318:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945670144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388016.878461:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945669888:0@lo:400:kworker.0 00000100:00100000:0.0:1787388016.878496:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388016.878522:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945670400:0@lo:400:kworker.0 00000100:00100000:0.0:1787388016.878553:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388016.878563:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945670912:0@lo:400:kworker.0 00000100:00100000:0.0:1787388016.878600:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388016.878609:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945670784:0@lo:400:kworker.0 00000100:00100000:0.0:1787388016.878637:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945669888 00000100:00100000:0.0:1787388016.878642:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945669888 00000100:00100000:1.0:1787388016.878643:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388016.878671:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787388016.878678:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945669888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388016.878708:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945669888:12345-0@lo:400:kworker.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388016.878715:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787388016.878822:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b74f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945670016:0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.878912:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388016.878930:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945670528:0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.878947:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388016.878961:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945671040:0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.878977:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388016.879040:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945670144:12345-0@lo:400:kworker.0 Request processed in 722us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388016.879048:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787388016.879064:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945670400 00000100:00100000:2.0:1787388016.879067:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945670400 00000100:00100000:2.0:1787388016.879083:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787388016.879089:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945670400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.879134:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945670272 00000100:00100000:3.0:1787388016.879138:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945670272 00000100:00100000:3.0:1787388016.879158:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945670016 00000100:00100000:3.0:1787388016.879160:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945670016 00000100:00100000:3.0:1787388016.879178:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945670528 00000100:00100000:3.0:1787388016.879181:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945670528 00000100:00100000:3.0:1787388016.879201:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945671040 00000100:00100000:3.0:1787388016.879204:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945671040 00000100:00100000:3.0:1787388016.879217:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787388016.879223:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945670272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.879286:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945670272:12345-0@lo:400:kworker.0 Request processed in 63us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388016.879292:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787388016.879304:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787388016.879309:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945670016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.879338:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945670016:12345-0@lo:400:kworker.0 Request processed in 29us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388016.879344:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787388016.879380:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787388016.879386:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945670528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.879412:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945670528:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388016.879417:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787388016.879428:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787388016.879433:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945671040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.879470:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945671040:12345-0@lo:400:kworker.0 Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388016.879475:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1787388016.879510:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388016.879546:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945670016:0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.879573:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945670528:0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.879583:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945671040:0@lo:400:kworker.0 00000100:00100000:1.0:1787388016.883756:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945670272:0@lo:400:kworker.0 00000100:00100000:1.0:1787388016.883799:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945669632 00000100:00100000:1.0:1787388016.883805:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945669632 00000100:00100000:1.0:1787388016.883867:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945669760 00000100:00100000:1.0:1787388016.883871:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945669760 00000100:00100000:1.0:1787388016.883888:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787388016.883897:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945669632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388016.883927:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388016.883987:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945669632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (5973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388016.883994:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787388016.884009:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787388016.884016:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945669760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388016.884037:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388016.884069:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945669760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (5956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388016.884075:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787388016.884101:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945670912 00000100:00100000:1.0:1787388016.884105:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945670912 00000100:00080000:3.0:1787388016.884113:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787388016.884119:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388016.884135:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945670784 00000100:00100000:1.0:1787388016.884139:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945670784 00000100:00100000:1.0:1787388016.884172:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787388016.884178:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945670912:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787388016.884213:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388016.884448:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945670400:12345-0@lo:400:kworker.0 Request processed in 5357us (5891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388016.884457:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787388016.884502:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787388016.884512:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945670784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388016.884569:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945670784:12345-0@lo:400:kworker.0 Request processed in 59us (5926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388016.884576:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787388016.884763:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945669888:0@lo:400:kworker.0 00000100:00100000:0.0:1787388016.884777:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945670400:0@lo:400:kworker.0 00000100:00100000:0.0:1787388016.884893:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388016.884937:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945671168:0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.884940:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945670656 00000100:00100000:3.0:1787388016.884946:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945670656 00000100:00100000:0.0:1787388016.884976:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787388016.885136:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43005880 x1874211945669632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388016.885154:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945669632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388016.885179:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b74f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945670144:0@lo:400:kworker.0 00010000:00080000:0.0:1787388016.885440:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311e680 x1874211945670784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388016.885462:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945670784:0@lo:400:kworker.0 00010000:00080000:0.0:1787388016.885477:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43006a00 x1874211945669760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388016.885488:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945669760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388016.885737:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945671168 00000100:00100000:3.0:1787388016.885743:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945671168 00000100:00100000:3.0:1787388016.885789:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787388016.885799:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945670656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388016.885810:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787388016.885821:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945671168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388016.886485:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945670912:12345-0@lo:400:kworker.0 Request processed in 2303us (7881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388016.886494:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787388016.886559:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7389c700 x1874211945670912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388016.886572:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945670912:0@lo:400:kworker.0 00000100:00100000:3.0:1787388016.886947:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945670656:12345-0@lo:400:kworker.0 Request processed in 1148us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388016.886956:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1787388016.886991:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787388016.887282:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43909880 x1874211945670656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388016.887294:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945670656:0@lo:400:kworker.0 00000100:00100000:0.0:1787388016.887547:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945671168:12345-0@lo:400:kworker.0 Request processed in 1727us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388016.887555:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00080000:3.0:1787388016.889108:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7389f100 x1874211945671168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388016.889125:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945671168:0@lo:400:kworker.0 00000001:02000400:0.0:1787388017.190247:0:11996:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:40:15 (1787388015) === 00010000:00010000:1.0:1787388017.261899:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388017.687269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388017.687375:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925667072 00000100:00100000:3.0:1787388017.687385:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925667072 00000100:00100000:3.0:1787388017.687441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 296 00000100:00100000:3.0:1787388017.687451:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+10:8754:x1874211925667072:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787388017.687466:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388017.687483:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b414a2400/0x26817551a4474553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7cd6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388017.687535:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b414a2400/0x26817551a4474553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cd6 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388017.687545:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b414a2400/0x26817551a4474553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cd6 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388017.687554:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b414a2400, rc 0) 00000100:00100000:3.0:1787388017.687618:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+11:8754:x1874211925667072:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 168us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.687626:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 296 00000100:00100000:0.0:1787388017.699488:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388017.699582:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925667200 00000100:00100000:3.0:1787388017.699592:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925667200 00000100:00100000:3.0:1787388017.699650:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 297 00000100:00100000:3.0:1787388017.699660:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+11:8754:x1874211925667200:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787388017.699838:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+11:8754:x1874211925667200:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 178us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.699845:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 297 00000100:00100000:2.0:1787388017.702861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388017.703403:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925667328 00000100:00100000:0.0:1787388017.703417:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925667328 00000100:00100000:0.0:1787388017.703485:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 298 00000100:00100000:0.0:1787388017.703495:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+11:8754:x1874211925667328:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787388017.703656:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+11:8754:x1874211925667328:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 161us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.703666:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 298 00000100:00100000:2.0:1787388017.719983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388017.720750:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925667456 00000100:00100000:0.0:1787388017.720765:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925667456 00000100:00100000:0.0:1787388017.720857:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 299 00000100:00100000:0.0:1787388017.720871:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+11:8758:x1874211925667456:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388017.721073:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+11:8758:x1874211925667456:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 205us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.721082:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 299 00000100:00100000:1.0:1787388017.759033:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388017.766458:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925667584 00000100:00100000:3.0:1787388017.766473:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925667584 00000100:00100000:3.0:1787388017.766539:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 300 00000100:00100000:3.0:1787388017.766550:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+11:8758:x1874211925667584:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388017.766717:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+11:8758:x1874211925667584:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 167us (7691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.766726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 300 00000100:00100000:3.0:1787388017.773637:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388017.773910:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925667712 00000100:00100000:2.0:1787388017.773921:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925667712 00000100:00100000:2.0:1787388017.773975:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 301 00000100:00100000:2.0:1787388017.773985:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+11:8758:x1874211925667712:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787388017.774130:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+11:8758:x1874211925667712:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 146us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388017.774139:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 301 00000100:00100000:2.0:1787388017.784886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388017.785051:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925667840 00000100:00100000:0.0:1787388017.785062:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925667840 00000100:00100000:0.0:1787388017.785118:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 302 00000100:00100000:0.0:1787388017.785128:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+11:8754:x1874211925667840:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787388017.785157:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388017.785187:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e08800/0x26817551a447455a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d07 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388017.785217:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e08800/0x26817551a447455a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d07 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388017.785228:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e08800/0x26817551a447455a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d07 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388017.785236:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08800, rc 0) 00000100:00100000:0.0:1787388017.787737:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+12:8754:x1874211925667840:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 172us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.787752:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 302 00000100:00100000:1.0:1787388017.789652:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388017.789744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925667968 00000100:00100000:3.0:1787388017.789763:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925667968 00000100:00100000:3.0:1787388017.789844:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 303 00000100:00100000:3.0:1787388017.789856:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+12:8754:x1874211925667968:12345-192.168.203.15@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787388017.789890:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787388017.789923:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787388017.789927:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787388017.789930:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787388017.789933:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787388017.789935:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787388017.795953:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+12:8754:x1874211925667968:12345-192.168.203.15@tcp:256:mount.lustre.0 Request processed in 6080us (6290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.795974:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 303 00000100:00100000:0.0:1787388017.802918:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388017.806240:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925668096 00000100:00100000:3.0:1787388017.806261:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925668096 00000100:00100000:3.0:1787388017.806417:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 304 00000100:00100000:3.0:1787388017.806429:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+12:8754:x1874211925668096:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787388017.806452:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388017.806475:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b414a2c00/0x26817551a4474561 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d0e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388017.806514:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b414a2c00/0x26817551a4474561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d0e expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388017.806539:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b414a2c00/0x26817551a4474561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d0e expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388017.806551:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b414a2c00, rc 0) 00000100:00100000:3.0:1787388017.806636:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:8754:x1874211925668096:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 210us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.806643:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 304 00000100:00100000:1.0:1787388017.815964:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388017.816101:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925668224 00000100:00100000:0.0:1787388017.816115:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925668224 00000100:00100000:0.0:1787388017.816191:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 305 00000100:00100000:0.0:1787388017.816202:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:8754:x1874211925668224:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787388017.816446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:8754:x1874211925668224:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 245us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.816455:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 305 00000100:00100000:0.0:1787388017.824215:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388017.824327:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925668352 00000100:00100000:2.0:1787388017.824339:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925668352 00000100:00100000:2.0:1787388017.824444:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 306 00000100:00100000:2.0:1787388017.824455:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:8754:x1874211925668352:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787388017.824641:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:8754:x1874211925668352:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 187us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388017.824650:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 306 00000100:00100000:2.0:1787388017.829324:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388017.829709:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925668480 00000100:00100000:3.0:1787388017.829722:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925668480 00000100:00100000:3.0:1787388017.829801:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 307 00000100:00100000:3.0:1787388017.829814:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:8762:x1874211925668480:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388017.830034:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:8762:x1874211925668480:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 221us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.830044:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 307 00000100:00100000:1.0:1787388017.842647:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388017.842919:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925668608 00000100:00100000:0.0:1787388017.842952:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925668608 00000100:00100000:0.0:1787388017.843014:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 308 00000100:00100000:0.0:1787388017.843027:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:8762:x1874211925668608:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388017.843230:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:8762:x1874211925668608:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 204us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.843240:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 308 00000100:00100000:2.0:1787388017.850930:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388017.850976:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388017.851130:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925668736 00000100:00100000:3.0:1787388017.851143:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925668736 00000100:00100000:3.0:1787388017.851201:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925668992 00000100:00100000:3.0:1787388017.851205:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925668992 00000100:00100000:3.0:1787388017.851236:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1787388017.851246:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874211925668736:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787388017.851286:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from b62f6a8b-2ad2-4bdc-a970-3ca92e68d862@192.168.203.15@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1787388017.851389:0:6520:0:(genops.c:1406:class_connect()) connect: client b62f6a8b-2ad2-4bdc-a970-3ca92e68d862, cookie 0x26817551a4474568 00000004:00100000:3.0:1787388017.851426:0:6520:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787388017.851593:0:6520:0:(import.c:65:import_set_state_nolock()) ffff996a42fcd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388017.851682:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2398:x1874211925668736:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 436us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.851691:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1787388017.851830:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:3.0:1787388017.851836:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874211925668992:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787388017.851855:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from b62f6a8b-2ad2-4bdc-a970-3ca92e68d862@192.168.203.15@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1787388017.851879:0:6520:0:(genops.c:1406:class_connect()) connect: client b62f6a8b-2ad2-4bdc-a970-3ca92e68d862, cookie 0x26817551a447456f 00000004:00100000:3.0:1787388017.851892:0:6520:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787388017.851975:0:6520:0:(import.c:65:import_set_state_nolock()) ffff996a42fce800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388017.852002:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2398:x1874211925668992:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 166us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.852009:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:1.0:1787388017.857887:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388017.857936:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388017.857990:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388017.858150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388017.866964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388017.869619:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925669376 00000100:00100000:0.0:1787388017.869639:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925669376 00000100:00100000:0.0:1787388017.869761:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925669504 00000100:00100000:0.0:1787388017.869765:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925669504 00000100:00100000:0.0:1787388017.869785:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925669248 00000100:00100000:0.0:1787388017.869788:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925669248 00000100:00100000:0.0:1787388017.869803:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925669120 00000100:00100000:0.0:1787388017.869806:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925669120 00000100:00100000:0.0:1787388017.869831:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 149 00000100:00100000:0.0:1787388017.869842:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925669376:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388017.869960:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925669376:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 119us (12088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.869969:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 149 00000100:00100000:0.0:1787388017.869989:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 150 00000100:00100000:0.0:1787388017.869995:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925669504:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388017.870021:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925669504:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (12085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.870029:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 150 00000100:00100000:0.0:1787388017.870040:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:0.0:1787388017.870047:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:8754:x1874211925669248:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787388017.870097:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787388017.870147:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:8754:x1874211925669248:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 101us (12157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.870153:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:0.0:1787388017.870165:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:0.0:1787388017.870171:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:0:x1874211925669120:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787388017.870188:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388017.870223:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:0:x1874211925669120:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 52us (12073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.870230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00080000:2.0:1787388017.871413:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388017.871423:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388017.871951:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925668864 00000100:00100000:0.0:1787388017.871964:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925668864 00000100:00100000:0.0:1787388017.872026:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:0.0:1787388017.872037:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:0:x1874211925668864:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787388017.872072:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787388017.872150:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:0:x1874211925668864:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 115us (5202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.872158:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:0.0:1787388017.876285:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388017.877391:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925669632 00000100:00100000:2.0:1787388017.877503:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925669632 00000100:00100000:2.0:1787388017.877597:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:2.0:1787388017.877609:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:8754:x1874211925669632:12345-192.168.203.15@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787388017.877848:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:8754:x1874211925669632:12345-192.168.203.15@tcp:40:mount.lustre.0 Request processed in 240us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388017.877857:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:2.0:1787388017.885504:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388017.885552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388017.885596:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388017.887427:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925669760 00000100:00100000:3.0:1787388017.887447:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925669760 00000100:00100000:3.0:1787388017.887500:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925669888 00000100:00100000:3.0:1787388017.887504:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925669888 00000100:00100000:3.0:1787388017.887541:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1787388017.887552:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874211925669760:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787388017.887598:0:8490:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from b62f6a8b-2ad2-4bdc-a970-3ca92e68d862@192.168.203.15@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1787388017.887640:0:8490:0:(genops.c:1406:class_connect()) connect: client b62f6a8b-2ad2-4bdc-a970-3ca92e68d862, cookie 0x26817551a4474576 00002000:00100000:3.0:1787388017.887656:0:8490:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b62f6a8b-2ad2-4bdc-a970-3ca92e68d862/ffff996a42fc8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787388017.887679:0:8490:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787388017.887850:0:8490:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787388017.887891:0:8490:0:(import.c:65:import_set_state_nolock()) ffff996a42fc9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388017.887981:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2398:x1874211925669760:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 429us (2426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.887990:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1787388017.888011:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1787388017.888016:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874211925669888:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787388017.888035:0:8490:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from b62f6a8b-2ad2-4bdc-a970-3ca92e68d862@192.168.203.15@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1787388017.888054:0:8490:0:(genops.c:1406:class_connect()) connect: client b62f6a8b-2ad2-4bdc-a970-3ca92e68d862, cookie 0x26817551a447457d 00002000:00100000:3.0:1787388017.888060:0:8490:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b62f6a8b-2ad2-4bdc-a970-3ca92e68d862/ffff996a42fcb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787388017.888067:0:8490:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787388017.888129:0:8490:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787388017.888147:0:8490:0:(import.c:65:import_set_state_nolock()) ffff996a42fcf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388017.888172:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2398:x1874211925669888:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 154us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.888179:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1787388017.888841:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925670016 00000100:00100000:0.0:1787388017.888850:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925670016 00000100:00100000:0.0:1787388017.888911:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:0.0:1787388017.888921:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:8754:x1874211925670016:12345-192.168.203.15@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787388017.888975:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:8754:x1874211925670016:12345-192.168.203.15@tcp:900:mount.lustre.0 Request processed in 56us (3488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388017.888993:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:1.0:1787388017.891903:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388017.892013:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925670144 00000100:00100000:3.0:1787388017.892027:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925670144 00000100:00100000:3.0:1787388017.892096:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:3.0:1787388017.892108:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:8754:x1874211925670144:12345-192.168.203.15@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787388017.892241:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787388017.893500:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:8754:x1874211925670144:12345-192.168.203.15@tcp:33:mount.lustre.0 Request processed in 1380us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.893516:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:2.0:1787388017.902103:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388017.902137:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945671296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388017.902239:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388017.902590:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945671296 00000100:00100000:3.0:1787388017.902601:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945671296 00000100:00100000:3.0:1787388017.902812:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787388017.902825:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945671296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388017.902863:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388017.902927:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945671296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388017.902935:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787388017.903057:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945671296:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388018.289427:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388018.933476:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388018.933510:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945671424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388018.933703:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388018.933717:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945671552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388018.937935:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388018.941630:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388018.962909:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945671552 00000100:00100000:3.0:1787388018.962930:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945671552 00000100:00100000:2.0:1787388018.964135:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787388018.964164:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7509d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945671552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388018.964200:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388018.964317:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7509d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945671552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 170us (22697us total) trans 0 rc 0/0 00000100:00080000:3.0:1787388018.964322:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388018.964325:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1787388018.964486:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f591880 x1874211945671552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388018.964511:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945671552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388018.964916:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945671424 00000100:00100000:1.0:1787388018.964928:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945671424 00000100:00100000:1.0:1787388018.965003:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787388018.965013:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945671424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388018.965029:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388018.965086:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945671424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (27162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388018.965092:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1787388018.965131:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58ea00 x1874211945671424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388018.965146:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945671424:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787388018.966005:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787388019.311213:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388020.335406:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388020.972600:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388020.975553:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945671680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388020.975650:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388020.977465:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945671680 00000100:00100000:3.0:1787388020.977481:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945671680 00000100:00100000:3.0:1787388020.977569:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787388020.977582:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945671680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388020.977630:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388020.977729:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945671680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388020.977737:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787388020.978171:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945671680:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787388021.357009:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388021.996617:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945672064:0@lo:400:kworker.0 00000100:00100000:2.0:1787388021.996693:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388021.996736:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b44948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945672576:0@lo:400:kworker.0 00000100:00100000:2.0:1787388021.996773:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388021.996797:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945673088:0@lo:400:kworker.0 00000100:00100000:2.0:1787388021.996832:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388021.996861:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787388021.996868:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945672192:0@lo:400:kworker.0 00000100:00100000:2.0:1787388021.996890:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388021.996907:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a422a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945672704:0@lo:400:kworker.0 00000100:00100000:2.0:1787388021.996929:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388021.996947:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945673216:0@lo:400:kworker.0 00000100:00100000:2.0:1787388021.996967:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388021.997004:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945672576 00000100:00100000:2.0:1787388021.997011:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945672576 00000100:00100000:2.0:1787388021.997060:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945673088 00000100:00100000:2.0:1787388021.997064:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945673088 00000100:00100000:2.0:1787388021.997078:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945672192 00000100:00100000:2.0:1787388021.997081:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945672192 00000100:00100000:3.0:1787388021.997243:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945671936:0@lo:400:kworker.0 00000100:00100000:3.0:1787388021.997272:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388021.997284:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945672448:0@lo:400:kworker.0 00000100:00100000:3.0:1787388021.997303:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388021.997311:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945672960:0@lo:400:kworker.0 00000100:00100000:3.0:1787388021.997326:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388021.997337:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787388021.997342:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945671808:0@lo:400:kworker.0 00000100:00100000:3.0:1787388021.997391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388021.997414:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945672320:0@lo:400:kworker.0 00000100:00100000:3.0:1787388021.997434:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388021.997450:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a422a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945672832:0@lo:400:kworker.0 00000100:00100000:3.0:1787388021.997470:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388021.997486:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945673344:0@lo:400:kworker.0 00000100:00100000:3.0:1787388021.997530:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388021.997563:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945672064 00000100:00100000:3.0:1787388021.997567:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945672064 00000100:00100000:3.0:1787388021.997588:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945672320 00000100:00100000:3.0:1787388021.997590:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945672320 00000100:00100000:3.0:1787388021.997605:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787388021.997613:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945672064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388021.997667:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945672064:12345-0@lo:400:kworker.0 Request processed in 54us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388021.997675:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787388021.997694:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787388021.997701:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945672320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388021.997733:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945672320:12345-0@lo:400:kworker.0 Request processed in 32us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388021.997739:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787388021.997760:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945671936 00000100:00100000:3.0:1787388021.997763:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945671936 00000100:00100000:2.0:1787388021.997812:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787388021.997822:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945672576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388021.997856:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945672576:12345-0@lo:400:kworker.0 Request processed in 36us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388021.998767:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945672448 00000100:00100000:1.0:1787388021.998774:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945672448 00000100:00100000:0.0:1787388021.998923:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388021.998935:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945673472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388021.998975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388022.002658:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945672960 00000100:00100000:3.0:1787388022.002681:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945672960 00000100:00100000:3.0:1787388022.002722:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787388022.002731:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945673088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.002813:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945673088:12345-0@lo:400:kworker.0 Request processed in 84us (5981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.002821:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787388022.002839:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787388022.002844:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945672192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.002873:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945672192:12345-0@lo:400:kworker.0 Request processed in 29us (5983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.002888:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787388022.002900:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787388022.002906:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945671936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.002937:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945671936:12345-0@lo:400:kworker.0 Request processed in 31us (5664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.002942:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787388022.002955:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787388022.002960:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945672960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.002986:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945672960:12345-0@lo:400:kworker.0 Request processed in 26us (5658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.002992:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787388022.003017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945671808 00000100:00100000:3.0:1787388022.003021:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945671808 00000100:00100000:3.0:1787388022.003056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787388022.003062:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945671808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.003090:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945671808:12345-0@lo:400:kworker.0 Request processed in 28us (5698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.003108:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787388022.003139:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945672704 00000100:00100000:3.0:1787388022.003143:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945672704 00000100:00100000:3.0:1787388022.003160:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945673216 00000100:00100000:3.0:1787388022.003164:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945673216 00000100:00100000:3.0:1787388022.003175:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945672832 00000100:00100000:3.0:1787388022.003177:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945672832 00000100:00100000:3.0:1787388022.003189:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945673344 00000100:00100000:3.0:1787388022.003192:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945673344 00000100:00100000:3.0:1787388022.003207:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787388022.003219:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945672704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.003251:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945672704:12345-0@lo:400:kworker.0 Request processed in 33us (6321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.003257:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787388022.003269:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787388022.003274:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945673216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.003299:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945673216:12345-0@lo:400:kworker.0 Request processed in 26us (6332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.003305:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787388022.003314:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787388022.003319:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945672832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.003370:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945672832:12345-0@lo:400:kworker.0 Request processed in 50us (5898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.003375:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787388022.003386:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787388022.003391:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945673344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.003417:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945673344:12345-0@lo:400:kworker.0 Request processed in 26us (5887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.003422:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787388022.003461:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945671808:0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.003475:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945672320:0@lo:400:kworker.0 00010000:00080000:3.0:1787388022.004165:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a422a8e00 x1874211945672832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388022.004178:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a422a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945672832:0@lo:400:kworker.0 00010000:00080000:3.0:1787388022.004203:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43004a80 x1874211945673344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388022.004211:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945673344:0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.004223:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945671936:0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.004233:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945672960:0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.004280:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945673600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388022.004319:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388022.004384:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945672192:0@lo:400:kworker.0 00010000:00080000:3.0:1787388022.004396:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a422a9880 x1874211945672704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388022.004404:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a422a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945672704:0@lo:400:kworker.0 00010000:00080000:3.0:1787388022.004415:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43006300 x1874211945673216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388022.004423:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945673216:0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.004434:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945672064:0@lo:400:kworker.0 00010000:00080000:3.0:1787388022.004446:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b44948700 x1874211945672576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388022.004454:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b44948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945672576:0@lo:400:kworker.0 00010000:00080000:3.0:1787388022.004466:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43005180 x1874211945673088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388022.004474:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945673088:0@lo:400:kworker.0 00000100:00100000:3.0:1787388022.004647:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945673472 00000100:00100000:3.0:1787388022.004652:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945673472 00000100:00100000:3.0:1787388022.004701:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945673600 00000100:00100000:3.0:1787388022.004704:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945673600 00000100:00100000:3.0:1787388022.004720:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787388022.004727:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945673472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388022.004750:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388022.004790:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945673472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (5814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.004797:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787388022.004811:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787388022.004817:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945673600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388022.004826:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388022.004853:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945673600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388022.004859:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1787388022.004887:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311c380 x1874211945673472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388022.004901:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945673472:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787388022.004927:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4311ca80 x1874211945673600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388022.004938:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945673600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388022.005070:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1787388022.006239:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787388022.006245:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388022.006248:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388022.006251:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388022.006343:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787388022.006383:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945672448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388022.006459:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945672448:12345-0@lo:400:kworker.0 Request processed in 84us (9153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388022.006475:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787388022.006656:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945672448:0@lo:400:kworker.0 00010000:00010000:0.0:1787388022.380748:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388023.020615:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388023.020638:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4311fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945673728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388023.020703:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388023.020835:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945673728 00000100:00100000:0.0:1787388023.020843:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945673728 00000100:00100000:0.0:1787388023.020897:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787388023.020906:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945673728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388023.020939:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388023.020989:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945673728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388023.020997:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787388023.021050:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4311fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945673728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388023.045925:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388023.045976:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388023.046009:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388023.046048:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388023.046087:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388023.046107:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388023.046132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388023.046298:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925670528 00000100:00100000:1.0:1787388023.046311:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925670528 00000100:00100000:1.0:1787388023.046423:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925670784 00000100:00100000:1.0:1787388023.046428:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925670784 00000100:00100000:1.0:1787388023.046445:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925670400 00000100:00100000:1.0:1787388023.046447:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925670400 00000100:00100000:1.0:1787388023.046460:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925670656 00000100:00100000:1.0:1787388023.046463:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925670656 00000100:00100000:1.0:1787388023.046482:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 157 00000100:00100000:1.0:1787388023.046503:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925670528:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388023.046595:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925670528:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 94us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388023.046603:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 157 00000100:00100000:1.0:1787388023.046621:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 158 00000100:00100000:1.0:1787388023.046629:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2402:x1874211925670784:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388023.046654:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2402:x1874211925670784:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388023.046671:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 158 00000100:00100000:1.0:1787388023.046682:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 159 00000100:00100000:1.0:1787388023.046689:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925670400:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388023.046713:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925670400:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388023.046738:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 159 00000100:00100000:1.0:1787388023.046750:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 160 00000100:00100000:1.0:1787388023.046757:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2402:x1874211925670656:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388023.046784:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2402:x1874211925670656:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 28us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388023.046789:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 160 00000100:00100000:2.0:1787388023.047441:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925671040 00000100:00100000:2.0:1787388023.047457:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925671040 00000100:00100000:2.0:1787388023.047506:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925670912 00000100:00100000:2.0:1787388023.047509:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925670912 00000100:00100000:2.0:1787388023.047533:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:2.0:1787388023.047542:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2402:x1874211925671040:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388023.047591:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2402:x1874211925671040:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 51us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388023.047598:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:2.0:1787388023.047613:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1787388023.047620:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2402:x1874211925670912:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388023.047645:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2402:x1874211925670912:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388023.047651:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00080000:0.0:1787388023.047989:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388023.048002:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388023.048005:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388023.048008:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388023.048646:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925670272 00000100:00100000:3.0:1787388023.048655:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925670272 00000100:00100000:3.0:1787388023.048761:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 310 00000100:00100000:3.0:1787388023.048779:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925670272:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388023.048835:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925670272:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 58us (2925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388023.048842:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 310 00010000:00010000:3.0:1787388023.415875:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787388023.541314:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000001:00100000:0.0:1787388023.542992:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000001:00100000:1.0:1787388023.543097:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000001:00100000:2.0:1787388023.544007:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000100:00100000:2.0:1787388024.044746:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388024.044767:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945673856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388024.044832:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388024.044931:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945673856 00000100:00100000:1.0:1787388024.044939:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945673856 00000100:00100000:1.0:1787388024.045040:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787388024.045050:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945673856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388024.045075:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388024.045134:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945673856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388024.045140:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1787388024.045179:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58f800 x1874211945673856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388024.045195:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945673856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388024.046916:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388024.046933:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945673984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388024.046983:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388024.047080:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945673984 00000100:00100000:2.0:1787388024.047087:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945673984 00000100:00080000:0.0:1787388024.049011:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388024.050856:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787388024.050870:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945673984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388024.050895:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388024.050977:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945673984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388024.050983:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1787388024.051061:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58f800 x1874211945673984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388024.051081:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945673984:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787388024.429147:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787388024.710868:0:12190:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787388025.452589:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388026.092698:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388026.092733:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945674112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388026.092795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388026.092929:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945674112 00000100:00100000:3.0:1787388026.092937:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945674112 00000100:00100000:3.0:1787388026.092992:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787388026.093001:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945674112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388026.093034:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388026.093082:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945674112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388026.093089:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787388026.093160:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945674112:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787388026.476462:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388027.117177:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388027.117207:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945674240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388027.117272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.117338:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388027.117368:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945674368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388027.117394:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.117421:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945674240 00000100:00100000:0.0:1787388027.117428:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945674240 00000100:00100000:0.0:1787388027.117483:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945674368 00000100:00100000:0.0:1787388027.117487:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945674368 00000100:00100000:0.0:1787388027.117504:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787388027.117512:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945674240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388027.117538:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388027.117579:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945674240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388027.117585:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787388027.117600:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787388027.117606:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945674368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388027.117615:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388027.117646:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945674368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388027.117651:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787388027.117684:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787388027.117715:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c55180 x1874211945674368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388027.117732:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945674368:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787388027.117759:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43004a80 x1874211945674240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388027.117769:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945674240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388027.118099:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945674752:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118131:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388027.118152:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945675264:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118176:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388027.118202:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945675776:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118225:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388027.118241:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787388027.118247:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945674624:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118268:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388027.118283:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945675136:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118308:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388027.118323:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945675648:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388027.118390:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945674752 00000100:00100000:1.0:1787388027.118394:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945674752 00000100:00100000:1.0:1787388027.118421:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787388027.118427:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945674752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118470:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945674752:12345-0@lo:400:kworker.0 Request processed in 33us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.118477:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787388027.118496:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945675264 00000100:00100000:1.0:1787388027.118498:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945675264 00000100:00100000:1.0:1787388027.118520:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945675776 00000100:00100000:1.0:1787388027.118523:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945675776 00000100:00100000:1.0:1787388027.118537:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945674624 00000100:00100000:1.0:1787388027.118539:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945674624 00000100:00100000:1.0:1787388027.118550:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945675136 00000100:00100000:1.0:1787388027.118556:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945675136 00000100:00100000:1.0:1787388027.118569:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945675648 00000100:00100000:1.0:1787388027.118571:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945675648 00000100:00100000:1.0:1787388027.118586:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787388027.118591:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945675264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118632:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945675264:12345-0@lo:400:kworker.0 Request processed in 40us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.118638:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787388027.118650:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787388027.118655:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945675776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118677:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945675776:12345-0@lo:400:kworker.0 Request processed in 23us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.118683:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787388027.118693:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787388027.118699:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945674624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118725:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945674624:12345-0@lo:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.118730:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787388027.118740:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787388027.118745:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945675136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118766:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945675136:12345-0@lo:400:kworker.0 Request processed in 22us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.118769:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787388027.118776:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787388027.118782:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945675648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118804:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945675648:12345-0@lo:400:kworker.0 Request processed in 23us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.118810:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787388027.118855:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945674624:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118886:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945675136:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118900:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945675648:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118909:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945674752:0@lo:400:kworker.0 00010000:00080000:1.0:1787388027.118919:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58f800 x1874211945675264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388027.118928:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945675264:0@lo:400:kworker.0 00000100:00080000:0.0:1787388027.118928:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388027.118932:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787388027.118937:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58d880 x1874211945675776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388027.118942:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945674496:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118945:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945675776:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.118971:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.118994:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945675008:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.118995:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945674496 00000100:00100000:1.0:1787388027.118998:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945674496 00000100:00100000:0.0:1787388027.119015:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388027.119024:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787388027.119029:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945675520:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.119030:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945674496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.119050:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388027.119056:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945674496:12345-0@lo:400:kworker.0 Request processed in 28us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.119063:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787388027.119072:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945674496:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.119079:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787388027.119083:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945674880:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.119101:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388027.119119:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945675392:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.119121:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945674880 00000100:00100000:1.0:1787388027.119124:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945674880 00000100:00100000:0.0:1787388027.119137:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388027.119143:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787388027.119148:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945674880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.119160:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945675520 00000100:00100000:0.0:1787388027.119163:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945675520 00000100:00100000:1.0:1787388027.119178:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945674880:12345-0@lo:400:kworker.0 Request processed in 30us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388027.119183:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787388027.119200:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945675392 00000100:00100000:0.0:1787388027.119204:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945675392 00000100:00100000:1.0:1787388027.119215:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945674880:0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.119243:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787388027.119250:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945675520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.119287:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945675520:12345-0@lo:400:kworker.0 Request processed in 38us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388027.119293:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787388027.119306:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787388027.119312:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945675392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388027.119336:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945675392:12345-0@lo:400:kworker.0 Request processed in 25us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388027.119342:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1787388027.119378:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388027.119389:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945675008 00000100:00100000:0.0:1787388027.119392:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945675008 00000100:00100000:2.0:1787388027.119439:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787388027.119448:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945675008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388027.119492:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945675008:12345-0@lo:400:kworker.0 Request processed in 46us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388027.119498:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1787388027.119572:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58ed80 x1874211945675392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388027.119581:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945675392:0@lo:400:kworker.0 00000100:00100000:1.0:1787388027.119591:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945675008:0@lo:400:kworker.0 00010000:00080000:1.0:1787388027.119599:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58df80 x1874211945675520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388027.119607:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945675520:0@lo:400:kworker.0 00010000:00010000:3.0:1787388027.501601:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388028.142008:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388028.142033:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945675904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388028.142102:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388028.142220:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945675904 00000100:00100000:3.0:1787388028.142228:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945675904 00000100:00100000:3.0:1787388028.142773:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787388028.142785:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945675904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388028.142827:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388028.142895:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945675904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388028.142903:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787388028.143053:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945675904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388028.163856:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388028.163911:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925671168 00000100:00100000:1.0:1787388028.163925:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925671168 00000100:00100000:1.0:1787388028.163992:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 312 00000100:00100000:1.0:1787388028.164003:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925671168:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388028.164208:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925671168:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 206us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388028.164217:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 312 00000100:00100000:1.0:1787388028.173968:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388028.174046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388028.175939:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388028.175952:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925671424 00000100:00100000:2.0:1787388028.175963:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925671424 00000100:00100000:1.0:1787388028.175964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388028.175980:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388028.176002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388028.176018:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925671680 00000100:00100000:2.0:1787388028.176021:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925671680 00000100:00100000:2.0:1787388028.176035:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925671296 00000100:00100000:1.0:1787388028.176035:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925671936 00000100:00100000:2.0:1787388028.176038:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925671296 00000100:00100000:1.0:1787388028.176038:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925671936 00000100:00100000:2.0:1787388028.176048:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925671552 00000100:00100000:2.0:1787388028.176051:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925671552 00000100:00100000:1.0:1787388028.176061:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925671808 00000100:00100000:1.0:1787388028.176064:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925671808 00000100:00100000:2.0:1787388028.176065:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 167 00000100:00100000:2.0:1787388028.176074:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925671424:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388028.176082:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:1.0:1787388028.176087:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925671936:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388028.176141:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925671424:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 67us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388028.176148:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 167 00000100:00100000:2.0:1787388028.176165:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 168 00000100:00100000:2.0:1787388028.176172:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925671680:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388028.176308:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 169 00000100:00100000:3.0:1787388028.176318:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925671296:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388028.176374:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925671936:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 286us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388028.176375:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925671680:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 204us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388028.176382:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:2.0:1787388028.176389:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 168 00000100:00100000:1.0:1787388028.176396:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:2.0:1787388028.176400:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 170 00000100:00100000:1.0:1787388028.176402:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925671808:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388028.176405:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925671552:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388028.176425:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925671552:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 20us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388028.176425:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925671808:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388028.176432:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 170 00000100:00100000:1.0:1787388028.176432:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00080000:2.0:1787388028.176448:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388028.176467:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787388028.176470:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388028.176473:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388028.176528:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925671296:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 210us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388028.176913:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 169 00010000:00010000:3.0:1787388028.527839:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388029.165374:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945676032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388029.165456:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388029.167033:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945676032 00000100:00100000:3.0:1787388029.167045:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945676032 00000100:00100000:3.0:1787388029.167111:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787388029.167121:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945676032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388029.167150:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388029.167214:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945676032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388029.167222:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1787388029.168929:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43006300 x1874211945676032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388029.168952:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945676032:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787388029.171878:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388029.172122:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945676160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388029.172188:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388029.174960:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945676160 00000100:00100000:0.0:1787388029.174974:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945676160 00000100:00100000:0.0:1787388029.175045:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787388029.175054:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945676160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388029.175078:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388029.175155:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945676160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (2966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388029.175163:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1787388029.175232:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43006300 x1874211945676160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388029.175252:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945676160:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787388029.175916:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787388029.550166:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388030.576498:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388031.213520:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945676288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388031.213588:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388031.213678:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945676288 00000100:00100000:2.0:1787388031.213687:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945676288 00000100:00100000:2.0:1787388031.213734:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787388031.213743:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945676288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388031.213775:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388031.213840:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945676288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388031.213847:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787388031.213894:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945676288:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388031.597067:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388032.237571:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945676416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388032.237648:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388032.237705:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388032.237712:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945676544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388032.237736:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388032.237770:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945676416 00000100:00100000:2.0:1787388032.237777:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945676416 00000100:00100000:2.0:1787388032.237821:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945676544 00000100:00100000:2.0:1787388032.237824:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945676544 00000100:00100000:2.0:1787388032.237842:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787388032.237851:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945676416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388032.237881:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388032.237922:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945676416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388032.237930:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787388032.237946:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787388032.237953:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945676544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388032.237962:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388032.237983:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945676544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388032.237989:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787388032.238003:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787388032.238038:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a9ea00 x1874211945676544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388032.238056:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945676544:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787388032.238067:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c54e00 x1874211945676416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388032.238077:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945676416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388032.240509:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945677056:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.240578:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.240624:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945677568:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.240649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.240672:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787388032.240679:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945676928:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.240703:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.240720:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945677440:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.240740:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.240755:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945677952:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.240773:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388032.240808:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945677056 00000100:00100000:0.0:1787388032.240815:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945677056 00000100:00100000:0.0:1787388032.240855:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945677440 00000100:00100000:0.0:1787388032.240858:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945677440 00000100:00100000:0.0:1787388032.240879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945677952 00000100:00100000:0.0:1787388032.240881:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945677952 00000100:00100000:0.0:1787388032.240902:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787388032.240910:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945677056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.240959:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945677056:12345-0@lo:400:kworker.0 Request processed in 49us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.240966:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787388032.240983:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787388032.240989:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945677440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.241016:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945677440:12345-0@lo:400:kworker.0 Request processed in 27us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.241021:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787388032.241038:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787388032.241044:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945677952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.241071:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945677952:12345-0@lo:400:kworker.0 Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.241077:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787388032.241093:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945677568 00000100:00100000:0.0:1787388032.241096:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945677568 00000100:00100000:0.0:1787388032.241123:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787388032.241130:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945677568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.241158:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945677568:12345-0@lo:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.241164:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787388032.241189:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945676928 00000100:00100000:0.0:1787388032.241193:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945676928 00000100:00100000:0.0:1787388032.241375:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787388032.241383:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945676928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.241418:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945676928:12345-0@lo:400:kworker.0 Request processed in 37us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.241433:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1787388032.241466:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388032.241471:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388032.241500:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945676928:0@lo:400:kworker.0 00010000:00080000:0.0:1787388032.241514:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223d180 x1874211945677440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388032.241524:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945677440:0@lo:400:kworker.0 00010000:00080000:0.0:1787388032.241534:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223dc00 x1874211945677952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388032.241550:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945677952:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.241562:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945677056:0@lo:400:kworker.0 00010000:00080000:0.0:1787388032.241571:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223ce00 x1874211945677568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388032.241579:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945677568:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.241803:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945676672:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.241840:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.241878:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945677184:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.241902:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.241916:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945677696:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.241945:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.241973:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787388032.241980:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945676800:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.242002:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.242015:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945677312:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.242035:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.242048:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945677824:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.242066:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388032.242090:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945677696 00000100:00100000:3.0:1787388032.242095:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945677696 00000100:00100000:3.0:1787388032.242128:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787388032.242135:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945677696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.242169:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945677696:12345-0@lo:400:kworker.0 Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388032.242175:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787388032.242213:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223df80 x1874211945677696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388032.242223:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945677696:0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.242540:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945676672 00000100:00100000:0.0:1787388032.242545:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945676672 00000100:00100000:0.0:1787388032.242582:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787388032.242589:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945676672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.242736:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945676672:12345-0@lo:400:kworker.0 Request processed in 147us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.242744:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787388032.242774:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945676800 00000100:00100000:0.0:1787388032.242779:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945676800 00000100:00100000:0.0:1787388032.242800:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945677312 00000100:00100000:0.0:1787388032.242803:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945677312 00000100:00100000:0.0:1787388032.242817:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945677824 00000100:00100000:0.0:1787388032.242819:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945677824 00000100:00100000:0.0:1787388032.242835:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787388032.242840:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945676800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.242870:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945676800:12345-0@lo:400:kworker.0 Request processed in 30us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.242875:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787388032.242886:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787388032.242891:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945677312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.242930:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945677312:12345-0@lo:400:kworker.0 Request processed in 39us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.242936:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787388032.242947:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787388032.242952:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945677824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.242977:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945677824:12345-0@lo:400:kworker.0 Request processed in 25us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.242983:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1787388032.243003:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388032.243007:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388032.243021:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945677184 00000100:00100000:0.0:1787388032.243024:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945677184 00000100:00100000:0.0:1787388032.243049:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787388032.243055:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945677184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388032.243085:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945677184:12345-0@lo:400:kworker.0 Request processed in 30us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388032.243091:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787388032.243158:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945676800:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.243168:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945677312:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.243177:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945677824:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.243186:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945676672:0@lo:400:kworker.0 00000100:00100000:3.0:1787388032.243194:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945677184:0@lo:400:kworker.0 00010000:00010000:0.0:1787388032.620509:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787388032.655455:0:12509:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787388032.655715:0:12509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787388033.264627:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945678080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388033.264715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388033.264830:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945678080 00000100:00100000:3.0:1787388033.264839:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945678080 00000100:00100000:3.0:1787388033.264892:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787388033.264902:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945678080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388033.264936:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388033.264981:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945678080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388033.264987:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787388033.265129:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945678080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388033.284579:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388033.284624:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388033.284641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388033.284677:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388033.284694:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388033.284710:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388033.284727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388033.284751:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925672832 00000100:00100000:2.0:1787388033.284760:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925672832 00000100:00100000:2.0:1787388033.284813:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925672704 00000100:00100000:2.0:1787388033.284817:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925672704 00000100:00100000:2.0:1787388033.284841:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:2.0:1787388033.284852:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925672832:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388033.284919:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925672832:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388033.284927:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:2.0:1787388033.284943:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:2.0:1787388033.284949:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925672704:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388033.284992:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925672704:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388033.284998:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:2.0:1787388033.285017:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925672320 00000100:00100000:2.0:1787388033.285020:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925672320 00000100:00100000:2.0:1787388033.285040:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925672576 00000100:00100000:2.0:1787388033.285043:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925672576 00000100:00100000:2.0:1787388033.285054:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925672192 00000100:00100000:2.0:1787388033.285057:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925672192 00000100:00100000:2.0:1787388033.285068:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925672448 00000100:00100000:2.0:1787388033.285071:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925672448 00000100:00100000:2.0:1787388033.285085:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 177 00000100:00100000:2.0:1787388033.285090:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925672320:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388033.285119:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925672320:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388033.285126:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 177 00000100:00100000:2.0:1787388033.285137:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 178 00000100:00100000:2.0:1787388033.285143:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925672576:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388033.285164:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925672576:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 22us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388033.285170:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 178 00000100:00100000:2.0:1787388033.285179:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 179 00000100:00100000:2.0:1787388033.285185:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2399:x1874211925672192:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388033.285210:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2399:x1874211925672192:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388033.285226:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 179 00000100:00100000:2.0:1787388033.285238:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 180 00000100:00100000:2.0:1787388033.285247:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925672448:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388033.285269:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925672448:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388033.285274:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 180 00000100:00080000:2.0:1787388033.285296:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388033.285300:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388033.285302:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388033.285303:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388033.285612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925672064 00000100:00100000:3.0:1787388033.285618:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925672064 00000100:00100000:3.0:1787388033.285664:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 314 00000100:00100000:3.0:1787388033.285672:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2399:x1874211925672064:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388033.285712:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2399:x1874211925672064:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 41us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388033.285718:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 314 00010000:00010000:1.0:1787388033.644477:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388034.284513:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388034.284537:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945678208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388034.284938:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388034.285046:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945678208 00000100:00100000:0.0:1787388034.285053:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945678208 00000100:00100000:0.0:1787388034.285114:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787388034.285124:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945678208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388034.285152:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388034.285209:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945678208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388034.285217:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787388034.285498:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388034.285510:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945678336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388034.285548:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388034.285663:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945678336 00000100:00100000:0.0:1787388034.285674:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945678336 00000100:00100000:0.0:1787388034.285697:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787388034.285703:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945678336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388034.285713:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388034.285743:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945678336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388034.285748:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1787388034.285825:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7389dc00 x1874211945678336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388034.285840:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945678336:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787388034.286007:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787388034.286029:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4390b480 x1874211945678208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388034.286041:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945678208:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787388034.670335:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787388034.864958:0:12606:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787388034.865302:0:12606:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787388035.692553:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388036.332537:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388036.332728:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945678464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388036.332789:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388036.333676:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945678464 00000100:00100000:0.0:1787388036.333685:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945678464 00000100:00100000:1.0:1787388036.338389:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787388036.338419:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945678464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388036.338467:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388036.338547:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945678464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388036.338562:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787388036.338866:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945678464:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388036.719028:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787388036.972479:0:12703:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787388036.972875:0:12703:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787388037.356598:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388037.356623:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945678592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388037.356690:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388037.356903:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945678592 00000100:00100000:2.0:1787388037.356912:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945678592 00000100:00100000:2.0:1787388037.356983:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787388037.356994:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945678592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388037.357021:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388037.357063:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945678592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.357082:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1787388037.357214:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787388037.357409:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a15c00 x1874211945678592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388037.357428:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945678592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388037.357805:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945678720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388037.357845:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.359341:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945678720 00000100:00100000:3.0:1787388037.359401:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945678720 00000100:00100000:3.0:1787388037.359461:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787388037.359469:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945678720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388037.359490:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787388037.359574:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388037.363079:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945678720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3600us (5222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388037.363094:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787388037.363405:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945678848:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.363469:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787388037.363598:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7389f100 x1874211945678720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388037.363620:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945678720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388037.365533:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945679104:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.365598:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.365628:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945679616:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.365652:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.365671:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945680128:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.365691:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.365709:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787388037.365714:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945678976:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.365733:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.365746:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945679488:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.365762:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.365778:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945680000:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.365796:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.365838:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945679616 00000100:00100000:3.0:1787388037.365845:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945679616 00000100:00100000:3.0:1787388037.365887:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945680128 00000100:00100000:3.0:1787388037.365890:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945680128 00000100:00100000:3.0:1787388037.365902:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945678976 00000100:00100000:3.0:1787388037.365905:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945678976 00000100:00100000:3.0:1787388037.365914:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945679488 00000100:00100000:3.0:1787388037.365916:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945679488 00000100:00100000:3.0:1787388037.365941:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945680000 00000100:00100000:3.0:1787388037.365944:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945680000 00000100:00100000:3.0:1787388037.365960:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787388037.365967:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945679616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.366015:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945679616:12345-0@lo:400:kworker.0 Request processed in 47us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388037.366022:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787388037.366037:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787388037.366043:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945680128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.366067:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945680128:12345-0@lo:400:kworker.0 Request processed in 25us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388037.366073:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787388037.366083:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787388037.366088:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945678976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.366111:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945678976:12345-0@lo:400:kworker.0 Request processed in 23us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388037.366117:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787388037.366126:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787388037.366131:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945679488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.366507:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945679488:12345-0@lo:400:kworker.0 Request processed in 35us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388037.366521:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787388037.366535:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787388037.366541:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945680000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.366583:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945680000:12345-0@lo:400:kworker.0 Request processed in 42us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388037.366590:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:3.0:1787388037.366613:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388037.366618:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388037.366630:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945679360:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.366657:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.366679:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945679872:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.366700:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.366719:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787388037.366725:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945679232:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.366743:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.366758:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945679744:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.366777:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388037.366809:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945679104 00000100:00100000:3.0:1787388037.366814:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945679104 00000100:00100000:3.0:1787388037.366835:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945679360 00000100:00100000:3.0:1787388037.366838:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945679360 00000100:00100000:3.0:1787388037.366851:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787388037.366857:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945679104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.366889:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945679104:12345-0@lo:400:kworker.0 Request processed in 32us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388037.366895:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787388037.366916:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787388037.367038:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945679360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.367076:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945679360:12345-0@lo:400:kworker.0 Request processed in 154us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388037.367082:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787388037.367102:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945679872 00000100:00100000:3.0:1787388037.367105:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945679872 00000100:00100000:3.0:1787388037.367129:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945679744 00000100:00100000:3.0:1787388037.367132:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945679744 00000100:00100000:3.0:1787388037.367331:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787388037.367340:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945679872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.367402:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945679872:12345-0@lo:400:kworker.0 Request processed in 54us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388037.367453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945679232 00000100:00100000:1.0:1787388037.367457:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945679232 00000100:00100000:1.0:1787388037.367485:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787388037.367492:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945679232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388037.367524:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945679232:12345-0@lo:400:kworker.0 Request processed in 33us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388037.367530:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787388037.368478:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945678848 00000100:00100000:0.0:1787388037.368488:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945678848 00000100:00100000:0.0:1787388037.368540:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787388037.368548:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945678848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388037.368767:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945678848:12345-0@lo:400:kworker.0 Request processed in 219us (5297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388037.368775:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787388037.369365:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787388037.369378:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945679744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.369432:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945679744:12345-0@lo:400:kworker.0 Request processed in 59us (2654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388037.369439:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787388037.369500:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945679232:0@lo:400:kworker.0 00010000:00080000:2.0:1787388037.369516:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c0cbb80 x1874211945679744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388037.369525:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945679744:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.369538:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945679360:0@lo:400:kworker.0 00010000:00080000:2.0:1787388037.369548:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c0c8380 x1874211945679872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388037.369557:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945679872:0@lo:400:kworker.0 00000100:00100000:2.0:1787388037.369580:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945678848:0@lo:400:kworker.0 00000100:00080000:2.0:1787388037.369628:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388037.373571:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787388037.378332:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945678976:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.378379:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945679488:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.378401:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945680000:0@lo:400:kworker.0 00000100:00100000:3.0:1787388037.378414:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945679104:0@lo:400:kworker.0 00010000:00080000:3.0:1787388037.378427:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c0c8700 x1874211945679616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388037.378438:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945679616:0@lo:400:kworker.0 00010000:00080000:3.0:1787388037.378449:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b738e9880 x1874211945680128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388037.378457:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945680128:0@lo:400:kworker.0 00010000:00010000:1.0:1787388037.742294:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388038.380691:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945680256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388038.380759:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388038.381107:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945680256 00000100:00100000:2.0:1787388038.381115:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945680256 00000100:00100000:2.0:1787388038.381172:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787388038.381182:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945680256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388038.381213:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388038.399435:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945680256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 18246us (18666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388038.399465:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787388038.399781:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945680256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388038.402696:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388038.402736:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388038.402768:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925672960 00000100:00100000:2.0:1787388038.402779:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388038.402784:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925672960 00000100:00100000:2.0:1787388038.402807:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388038.402840:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388038.402873:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 316 00000100:00100000:3.0:1787388038.402887:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925672960:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388038.402936:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388038.402970:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925673216 00000100:00100000:2.0:1787388038.402979:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925673216 00000100:00100000:3.0:1787388038.402999:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925672960:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 112us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388038.403010:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 316 00000100:00100000:2.0:1787388038.403035:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925673472 00000100:00100000:2.0:1787388038.403041:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925673472 00000100:00100000:3.0:1787388038.403063:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925673088 00000100:00100000:3.0:1787388038.403069:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925673088 00000100:00100000:2.0:1787388038.403080:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925673344 00000100:00100000:2.0:1787388038.403086:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925673344 00000100:00100000:3.0:1787388038.403108:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 187 00000100:00100000:3.0:1787388038.403118:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925673216:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388038.403156:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925673216:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 40us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388038.403216:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925673600 00000100:00100000:0.0:1787388038.403221:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925673600 00000100:00100000:0.0:1787388038.403257:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:0.0:1787388038.403267:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2398:x1874211925673600:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:0.0:1787388038.403294:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474576 00000100:00080000:0.0:1787388038.403302:0:8436:0:(import.c:65:import_set_state_nolock()) ffff996a42fc9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787388038.403362:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787388038.403859:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+2:2398:x1874211925673600:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 592us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388038.403867:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00010000:00010000:0.0:1787388038.403902:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388038.406252:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 188 00000100:00100000:2.0:1787388038.406272:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925673472:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388038.406339:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925673472:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 77us (3533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388038.406363:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 188 00000100:00100000:2.0:1787388038.406391:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 189 00000100:00100000:2.0:1787388038.406400:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925673088:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388038.406430:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925673088:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 32us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388038.406436:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 189 00000100:00100000:2.0:1787388038.406450:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 190 00000100:00100000:2.0:1787388038.406456:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925673344:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388038.406625:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 187 00000100:00100000:3.0:1787388038.406768:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388038.406776:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925673344:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 316us (3839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388038.406786:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 190 00000100:00080000:2.0:1787388038.406825:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388038.406831:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388038.406834:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388038.408602:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925673728 00000100:00100000:0.0:1787388038.408621:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925673728 00000100:00100000:0.0:1787388038.408774:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:0.0:1787388038.408786:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2398:x1874211925673728:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:0.0:1787388038.408825:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447457d 00000100:00080000:0.0:1787388038.408838:0:8437:0:(import.c:65:import_set_state_nolock()) ffff996a42fcf800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1787388038.408863:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1787388038.408908:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1787388038.408981:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388038.409117:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+2:2398:x1874211925673728:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 334us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388038.409124:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00010000:00010000:2.0:1787388038.773523:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787388038.898992:0:12800:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388038.899315:0:12800:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787388039.406299:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945680384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388039.406433:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388039.406789:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945680384 00000100:00100000:3.0:1787388039.406801:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945680384 00000100:00100000:3.0:1787388039.406882:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787388039.406895:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945680384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388039.406935:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388039.407003:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945680384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388039.407011:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1787388039.407066:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f571500 x1874211945680384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388039.407114:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945680384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787388039.407311:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388039.407924:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945680512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388039.407981:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388039.408200:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945680512 00000100:00100000:0.0:1787388039.408208:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945680512 00000100:00100000:0.0:1787388039.408266:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787388039.408276:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945680512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388039.408295:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787388039.408411:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388039.408597:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945680512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 322us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388039.408606:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1787388039.409529:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7389c700 x1874211945680512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388039.409628:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945680512:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787388039.790406:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388040.816548:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787388041.062130:0:12898:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787388041.062575:0:12898:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787388041.452716:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388041.452748:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945680640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388041.452842:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388041.452991:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945680640 00000100:00100000:2.0:1787388041.453003:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945680640 00000100:00100000:2.0:1787388041.453066:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787388041.453078:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945680640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388041.453125:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388041.453178:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945680640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388041.453187:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787388041.454024:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945680640:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787388041.847543:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388042.476886:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945681024:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.476897:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945681152:0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.476961:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945680896:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.477046:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945680768:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.477198:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.477245:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945681664:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.477287:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.477306:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945682176:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.477325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.477382:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388042.477389:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945682048:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.477412:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388042.477462:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945681664 00000100:00100000:2.0:1787388042.477469:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945681664 00000100:00100000:2.0:1787388042.477515:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945682176 00000100:00100000:2.0:1787388042.477519:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945682176 00000100:00100000:2.0:1787388042.477540:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787388042.477550:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945681664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.477600:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945681664:12345-0@lo:400:kworker.0 Request processed in 51us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388042.477607:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787388042.477622:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787388042.477628:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945682176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.477654:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945682176:12345-0@lo:400:kworker.0 Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388042.477659:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787388042.477679:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945681152 00000100:00100000:2.0:1787388042.477681:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945681152 00000100:00100000:2.0:1787388042.477701:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945682048 00000100:00100000:2.0:1787388042.477703:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945682048 00000100:00100000:2.0:1787388042.477721:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787388042.477726:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945681152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.477756:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945681152:12345-0@lo:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388042.477769:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787388042.477782:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787388042.477787:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945682048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.477813:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945682048:12345-0@lo:400:kworker.0 Request processed in 26us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388042.477818:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:2.0:1787388042.477833:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388042.477837:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787388042.477839:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787388042.477875:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43804700 x1874211945682048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388042.477890:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945682048:0@lo:400:kworker.0 00000100:00100000:2.0:1787388042.477902:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945681152:0@lo:400:kworker.0 00010000:00080000:2.0:1787388042.477910:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a15c00 x1874211945681664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388042.477919:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945681664:0@lo:400:kworker.0 00010000:00080000:2.0:1787388042.477927:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43807100 x1874211945682176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388042.477935:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945682176:0@lo:400:kworker.0 00000100:00100000:0.0:1787388042.483463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388042.483612:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945681024 00000100:00100000:3.0:1787388042.483622:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945681024 00000100:00100000:3.0:1787388042.483678:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787388042.485371:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945681024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.485385:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388042.485454:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945681024:12345-0@lo:400:kworker.0 Request processed in 1766us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.485464:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787388042.485497:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945681024:0@lo:400:kworker.0 00000100:00100000:0.0:1787388042.485510:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945681536:0@lo:400:kworker.0 00000100:00100000:0.0:1787388042.485545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388042.485577:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945681536 00000100:00100000:3.0:1787388042.485584:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945681536 00000100:00100000:3.0:1787388042.485637:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787388042.485646:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945681536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.485681:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945681536:12345-0@lo:400:kworker.0 Request processed in 37us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.485688:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:3.0:1787388042.485709:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388042.485721:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388042.485746:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945681408:0@lo:400:kworker.0 00000100:00100000:0.0:1787388042.485747:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945680768 00000100:00100000:0.0:1787388042.485754:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945680768 00000100:00100000:3.0:1787388042.485778:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388042.485788:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787388042.485797:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945680768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.485808:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945681920:0@lo:400:kworker.0 00000100:00100000:0.0:1787388042.485834:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945680768:12345-0@lo:400:kworker.0 Request processed in 37us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388042.485842:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787388042.485850:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388042.485877:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945682560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388042.485880:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945682432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388042.485908:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388042.485928:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787388042.485946:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a14000 x1874211945681536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388042.485957:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945681536:0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.485969:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945682560 00000100:00100000:3.0:1787388042.485974:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945682560 00000100:00100000:3.0:1787388042.486011:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945682432 00000100:00100000:3.0:1787388042.486014:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945682432 00000100:00100000:3.0:1787388042.486036:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787388042.486043:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945682560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388042.486064:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388042.486081:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787388042.486092:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945682432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388042.486105:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945682560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (197us total) trans 0 rc 0/0 00002000:00000024:0.0:1787388042.486105:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388042.486126:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787388042.486146:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945682432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.486152:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945680896 00000100:00100000:3.0:1787388042.486157:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945680896 00000100:00100000:0.0:1787388042.486162:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787388042.486182:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945681408 00000100:00100000:3.0:1787388042.486186:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945681408 00000100:00100000:3.0:1787388042.486200:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945681920 00000100:00100000:3.0:1787388042.486202:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945681920 00000100:00100000:3.0:1787388042.486217:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787388042.486223:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945680896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.486251:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945680896:12345-0@lo:400:kworker.0 Request processed in 29us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.486258:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787388042.486269:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787388042.486275:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945681408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.486302:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945681408:12345-0@lo:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.486308:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787388042.486318:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787388042.486330:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945681920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.486399:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945681920:12345-0@lo:400:kworker.0 Request processed in 69us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388042.486405:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1787388042.486426:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388042.486429:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787388042.486448:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58a300 x1874211945682432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388042.486464:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945682432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388042.486476:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945680896:0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.486485:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945681408:0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.486493:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945681920:0@lo:400:kworker.0 00010000:00080000:3.0:1787388042.486527:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7389dc00 x1874211945682560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388042.486540:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945682560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388042.486661:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945680768:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.486671:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945681280:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.486698:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388042.486723:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945681792:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.486744:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388042.486809:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945682304:0@lo:400:kworker.0 00000100:00100000:1.0:1787388042.486829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388042.486917:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945681792 00000100:00100000:0.0:1787388042.486922:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945681792 00000100:00100000:0.0:1787388042.486998:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945682304 00000100:00100000:0.0:1787388042.487002:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945682304 00000100:00100000:0.0:1787388042.487031:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787388042.487037:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945681792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388042.487073:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945681792:12345-0@lo:400:kworker.0 Request processed in 37us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388042.487079:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787388042.487090:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787388042.487094:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945682304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388042.487117:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945682304:12345-0@lo:400:kworker.0 Request processed in 23us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388042.487122:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787388042.487154:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787388042.487174:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43804e00 x1874211945681792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388042.487185:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945681792:0@lo:400:kworker.0 00010000:00080000:1.0:1787388042.487195:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43807800 x1874211945682304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388042.487202:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945682304:0@lo:400:kworker.0 00000100:00100000:3.0:1787388042.493732:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945681280 00000100:00100000:3.0:1787388042.493746:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945681280 00000100:00100000:0.0:1787388042.495801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787388042.495824:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945681280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388042.495926:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945681280:12345-0@lo:400:kworker.0 Request processed in 111us (9226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388042.495933:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787388042.496056:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945681280:0@lo:400:kworker.0 00010000:00010000:2.0:1787388042.864502:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388043.515927:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945682688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388043.516039:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388043.516663:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945682688 00000100:00100000:2.0:1787388043.516677:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945682688 00000100:00100000:2.0:1787388043.516749:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787388043.516758:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787388043.516760:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945682688:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388043.516783:0:6526:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:2.0:1787388043.516820:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388043.528462:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945682688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11689us (12408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388043.528492:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787388043.528590:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945682688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388043.528722:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388043.528758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388043.528777:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388043.528815:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388043.528851:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388043.528879:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925673856 00000100:00100000:3.0:1787388043.528888:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925673856 00000100:00100000:3.0:1787388043.528936:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 318 00000100:00100000:3.0:1787388043.528944:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925673856:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388043.529174:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925673856:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 229us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388043.529183:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 318 00000100:00100000:3.0:1787388043.529217:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925674112 00000100:00100000:3.0:1787388043.529221:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925674112 00000100:00100000:3.0:1787388043.529254:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925674368 00000100:00100000:3.0:1787388043.529257:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925674368 00000100:00100000:3.0:1787388043.529274:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925673984 00000100:00100000:3.0:1787388043.529277:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925673984 00000100:00100000:3.0:1787388043.529289:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925674240 00000100:00100000:3.0:1787388043.529292:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925674240 00000100:00100000:3.0:1787388043.529306:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 197 00000100:00100000:3.0:1787388043.529312:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925674112:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388043.529388:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925674112:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 34us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388043.529394:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 197 00000100:00100000:3.0:1787388043.529408:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 198 00000100:00100000:3.0:1787388043.529414:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925674368:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388043.529440:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925674368:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388043.529446:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 198 00000100:00100000:3.0:1787388043.529465:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 199 00000100:00100000:3.0:1787388043.529472:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925673984:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388043.529499:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925673984:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 29us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388043.529505:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 199 00000100:00100000:3.0:1787388043.529716:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 200 00000100:00100000:3.0:1787388043.529728:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925674240:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388043.529757:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925674240:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 33us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388043.529763:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 200 00000100:00080000:3.0:1787388043.529948:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388043.529953:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787388043.884584:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388044.525029:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945682816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388044.525124:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388044.525251:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945682816 00000100:00100000:3.0:1787388044.525261:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945682816 00000100:00100000:1.0:1787388044.525605:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388044.525614:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945682944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388044.525649:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388044.525991:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787388044.526007:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945682816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388044.526046:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388044.526112:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945682816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388044.526120:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787388044.526142:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945682944 00000100:00100000:3.0:1787388044.526146:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945682944 00000100:00100000:3.0:1787388044.526173:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787388044.526179:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945682944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388044.526189:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388044.526213:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945682944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388044.526238:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1787388044.526259:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787388044.528006:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c108380 x1874211945682944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388044.528036:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945682944:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787388044.528051:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c108000 x1874211945682816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388044.528062:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945682816:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787388044.536687:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000020:00000080:2.0:1787388044.536700:0:9514:0:(genops.c:906:class_export_put()) final put ffff996a42fcb000/b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000020:00000080:3.0:1787388044.540712:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42fcb000/b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 for lustre-OST0001 00000020:00000080:3.0:1787388044.541057:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a42fcf800 for lustre-OST0001 00000001:00100000:0.0:1787388044.546537:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000020:00000080:0.0:1787388044.546551:0:8430:0:(genops.c:906:class_export_put()) final put ffff996a42fc8800/b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000020:00000080:2.0:1787388044.546628:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42fc8800/b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 for lustre-OST0000 00000020:00000080:2.0:1787388044.546684:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a42fc9000 for lustre-OST0000 00010000:00010000:0.0:1787388044.910641:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787388045.101235:0:13043:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787388045.936448:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388046.573757:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388046.573788:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945683072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388046.573881:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388046.573998:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945683072 00000100:00100000:0.0:1787388046.574009:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945683072 00000100:00100000:0.0:1787388046.574077:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787388046.574089:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945683072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388046.574146:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787388046.574228:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945683072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388046.574237:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787388046.574301:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945683072:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787388046.957473:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388047.597659:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388047.597683:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945683200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388047.597747:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388047.597810:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945683200 00000100:00100000:0.0:1787388047.597818:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945683200 00000100:00100000:0.0:1787388047.597876:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787388047.597895:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945683200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388047.597924:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388047.597963:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945683200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388047.597970:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1787388047.597989:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787388047.598017:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c0c8380 x1874211945683200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388047.598036:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945683200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388047.598395:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388047.598406:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945683328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388047.598439:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.598716:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945683712:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.598746:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.598762:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945684224:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.598791:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.598807:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945684736:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.598824:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.598840:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787388047.598845:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945683584:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.598864:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.598878:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945684096:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.598910:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.598925:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945684608:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.598943:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388047.598973:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945684224 00000100:00100000:3.0:1787388047.598979:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945684224 00000100:00100000:3.0:1787388047.599011:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945684736 00000100:00100000:3.0:1787388047.599014:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945684736 00000100:00100000:3.0:1787388047.599028:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945683584 00000100:00100000:3.0:1787388047.599030:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945683584 00000100:00100000:3.0:1787388047.599051:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945684096 00000100:00100000:3.0:1787388047.599053:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945684096 00000100:00100000:3.0:1787388047.599064:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945684608 00000100:00100000:3.0:1787388047.599067:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945684608 00000100:00100000:3.0:1787388047.599080:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787388047.599086:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945684224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.599328:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945684224:12345-0@lo:400:kworker.0 Request processed in 231us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.599336:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787388047.599369:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787388047.599376:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945684736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.599404:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945684736:12345-0@lo:400:kworker.0 Request processed in 28us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.599410:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787388047.599420:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787388047.599426:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945683584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.599450:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945683584:12345-0@lo:400:kworker.0 Request processed in 25us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.599457:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787388047.599466:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787388047.599471:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945684096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.599555:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945684096:12345-0@lo:400:kworker.0 Request processed in 83us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.599561:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787388047.599574:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787388047.599580:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945684608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.599626:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945684608:12345-0@lo:400:kworker.0 Request processed in 46us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.599632:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787388047.600508:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945683712 00000100:00100000:2.0:1787388047.600517:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945683712 00000100:00100000:2.0:1787388047.600560:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787388047.600567:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945683712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.600623:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945683712:12345-0@lo:400:kworker.0 Request processed in 57us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388047.600630:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787388047.600662:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945683456:0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.600699:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388047.600730:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945683968:0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.600751:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388047.600767:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945684480:0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.600806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388047.600827:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787388047.600833:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945683840:0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.600855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388047.600874:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945684352:0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.600909:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388047.600935:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945683456 00000100:00100000:2.0:1787388047.600938:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945683456 00000100:00100000:2.0:1787388047.600965:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787388047.600971:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945683456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.601003:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945683456:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388047.601010:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787388047.601034:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945683968 00000100:00100000:2.0:1787388047.601038:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945683968 00000100:00100000:2.0:1787388047.601058:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787388047.601064:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945683968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.601092:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945683968:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.601998:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945683840 00000100:00100000:3.0:1787388047.602007:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945683840 00000100:00100000:3.0:1787388047.602047:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787388047.602055:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945683840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.602117:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945683840:12345-0@lo:400:kworker.0 Request processed in 63us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388047.602124:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787388047.602176:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945683584:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.602189:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945684096:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.602200:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945684608:0@lo:400:kworker.0 00000100:00100000:3.0:1787388047.602211:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945683712:0@lo:400:kworker.0 00010000:00080000:3.0:1787388047.602224:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c108000 x1874211945684224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388047.602235:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945684224:0@lo:400:kworker.0 00010000:00080000:3.0:1787388047.602245:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43835180 x1874211945684736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388047.602253:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945684736:0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.602367:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787388047.602392:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945684480 00000100:00100000:2.0:1787388047.602395:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945684480 00000100:00100000:2.0:1787388047.602424:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945684352 00000100:00100000:2.0:1787388047.602427:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945684352 00000100:00100000:2.0:1787388047.602449:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787388047.602455:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945684480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.602487:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945684480:12345-0@lo:400:kworker.0 Request processed in 33us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388047.602504:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787388047.602515:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787388047.602520:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945684352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.602546:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945684352:12345-0@lo:400:kworker.0 Request processed in 26us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388047.602552:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787388047.602661:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945683840:0@lo:400:kworker.0 00010000:00080000:2.0:1787388047.602672:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c108380 x1874211945684352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388047.602680:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945684352:0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.602689:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945683456:0@lo:400:kworker.0 00000100:00100000:2.0:1787388047.602698:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945683968:0@lo:400:kworker.0 00010000:00080000:2.0:1787388047.602706:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43836a00 x1874211945684480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388047.602714:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945684480:0@lo:400:kworker.0 00000100:00100000:0.0:1787388047.603160:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945683328 00000100:00100000:0.0:1787388047.603167:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945683328 00000100:00100000:0.0:1787388047.603209:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787388047.603217:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945683328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388047.603234:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388047.603279:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945683328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (4840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388047.603285:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787388047.603314:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388047.603328:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388047.603332:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388047.603334:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787388047.603568:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f588380 x1874211945683328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388047.603585:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945683328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787388047.982037:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388048.623343:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388048.623387:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945684864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388048.623469:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388048.623567:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945684864 00000100:00100000:3.0:1787388048.623576:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945684864 00000100:00100000:3.0:1787388048.623624:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787388048.623633:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945684864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388048.623666:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388048.623731:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945684864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388048.623738:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787388048.623850:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945684864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388048.646225:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388048.646263:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388048.646305:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388048.646389:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388048.646420:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388048.646448:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925674624 00000100:00100000:2.0:1787388048.646456:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925674624 00000100:00100000:2.0:1787388048.646524:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925674880 00000100:00100000:2.0:1787388048.646527:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925674880 00000100:00100000:2.0:1787388048.646542:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925674752 00000100:00100000:2.0:1787388048.646544:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925674752 00000100:00100000:2.0:1787388048.646556:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925675008 00000100:00100000:2.0:1787388048.646558:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925675008 00000100:00100000:2.0:1787388048.646576:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 207 00000100:00100000:2.0:1787388048.646585:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2399:x1874211925674624:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388048.646657:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2399:x1874211925674624:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 72us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.646665:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 207 00000100:00100000:2.0:1787388048.646683:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 208 00000100:00100000:2.0:1787388048.646689:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925674880:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388048.646712:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925674880:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.646718:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 208 00000100:00100000:2.0:1787388048.646728:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 209 00000100:00100000:2.0:1787388048.646734:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925674752:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388048.646758:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925674752:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.646764:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 209 00000100:00100000:2.0:1787388048.646917:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 210 00000100:00100000:2.0:1787388048.646933:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925675008:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388048.646961:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925675008:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 29us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.646966:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 210 00000100:00080000:2.0:1787388048.646984:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388048.646989:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388048.647132:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925674496 00000100:00100000:1.0:1787388048.647137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925674496 00000100:00100000:1.0:1787388048.647176:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 320 00000100:00100000:1.0:1787388048.647184:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:2399:x1874211925674496:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388048.647212:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:2399:x1874211925674496:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 29us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388048.647219:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 320 00000020:00000080:3.0:1787388048.906928:0:13191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fffaa9ec3e0 00000020:00000080:3.0:1787388048.906944:0:13191:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787388048.906949:0:13191:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787388048.906956:0:13191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffaa9ee670 20000000:00000080:3.0:1787388048.906963:0:13191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996a431ea000 uarg=0000000000000000 20000000:01000000:3.0:1787388048.907004:0:13191:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787388048.907010:0:13191:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787388048.907014:0:13191:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787388048.913592:0:13192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787388048.913835:0:13191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787388048.932853:0:13191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787388048.933030:0:13191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933051:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b414a3400/0x26817551a4474514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ccf expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933060:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b74e09000/0x26817551a4474522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447451b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933067:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b74e08c00/0x26817551a4474530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474529 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933074:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a431e4a00/0x26817551a447453e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474537 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933080:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a431e5200/0x26817551a447454c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474545 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933087:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b414a2c00/0x26817551a4474561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d0e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933095:0:13191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933133:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b414a2c00/0x26817551a4474561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d0e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933159:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b414a2c00/0x26817551a4474561 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d0e expref: 12 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388048.933175:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945684992:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388048.933282:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a431e5200/0x26817551a447454c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474545 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933291:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a431e5200/0x26817551a447454c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474545 expref: 23 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388048.933300:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945685120:0@lo:104: 00000100:00100000:0.0:1787388048.933369:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787388048.933408:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a431e4a00/0x26817551a447453e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474537 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933417:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a431e4a00/0x26817551a447453e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474537 expref: 23 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388048.933426:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945685248:0@lo:104: 00000100:00100000:0.0:1787388048.933447:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787388048.933472:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b74e08c00/0x26817551a4474530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474529 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933491:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b74e08c00/0x26817551a4474530 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474529 expref: 23 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388048.933499:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945685376:0@lo:104: 00000100:00100000:0.0:1787388048.933520:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787388048.933550:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b74e09000/0x26817551a4474522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a447451b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933558:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b74e09000/0x26817551a4474522 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a447451b expref: 23 pid: 6514 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388048.933566:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945685504:0@lo:104: 00000100:00100000:0.0:1787388048.933588:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787388048.933605:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b414a3400/0x26817551a4474514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ccf expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388048.933613:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b414a3400/0x26817551a4474514 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ccf expref: 12 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388048.933621:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945685632:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388048.933644:0:13191:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42e08c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388048.933792:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945685120 00000100:00100000:2.0:1787388048.933800:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945685120 00000100:00100000:2.0:1787388048.933836:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945685248 00000100:00100000:2.0:1787388048.933839:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945685248 00000100:00100000:2.0:1787388048.933848:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945685376 00000100:00100000:2.0:1787388048.933851:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945685376 00000100:00100000:2.0:1787388048.933859:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945685504 00000100:00100000:2.0:1787388048.933861:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945685504 00000100:00100000:2.0:1787388048.933873:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787388048.933880:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+6:13191:x1874211945685120:12345-0@lo:104: 00010000:00010000:2.0:1787388048.933892:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.933938:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388048.933944:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+6:13191:x1874211945685120:12345-0@lo:104: Request processed in 65us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.933951:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787388048.933968:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787388048.933973:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+5:13191:x1874211945685248:12345-0@lo:104: 00010000:00010000:2.0:1787388048.933980:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934008:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787388048.934019:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+5:13191:x1874211945685248:12345-0@lo:104: Request processed in 46us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.934025:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787388048.934036:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787388048.934041:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+4:13191:x1874211945685376:12345-0@lo:104: 00010000:00010000:2.0:1787388048.934048:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934085:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787388048.934090:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+4:13191:x1874211945685376:12345-0@lo:104: Request processed in 49us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.934096:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787388048.934107:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787388048.934113:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:13191:x1874211945685504:12345-0@lo:104: 00010000:00010000:2.0:1787388048.934120:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934142:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787388048.934147:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+3:13191:x1874211945685504:12345-0@lo:104: Request processed in 35us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.934153:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787388048.934170:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787388048.934175:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934183:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08000 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388048.934187:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934207:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388048.934215:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388048.934221:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388048.934250:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934257:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388048.934275:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934282:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e08000/0x26817551a4474545 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447454c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934294:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787388048.934297:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934302:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4800 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388048.934305:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934326:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388048.934332:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388048.934342:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388048.934380:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934386:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388048.934401:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934408:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a431e4800/0x26817551a4474537 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447453e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934417:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388048.934420:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934426:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388048.934429:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934435:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388048.934440:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388048.934446:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388048.934458:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934463:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388048.934475:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934492:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e09200/0x26817551a4474529 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474530 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934500:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388048.934504:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934509:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5600 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388048.934512:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934518:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388048.934525:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388048.934530:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388048.934544:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934550:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388048.934556:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934562:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a431e5600/0x26817551a447451b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4474522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934575:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388048.934583:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388048.934585:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388048.934593:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388048.934613:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945685760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388048.934645:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388048.934671:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388048.934677:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945686144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388048.934696:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388048.934718:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945685888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388048.934737:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388048.934751:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388048.934756:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945686016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388048.934775:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388048.934796:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945685760 00000100:00100000:2.0:1787388048.934801:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945685760 00010000:00010000:2.0:1787388048.934818:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a431e5200/0x26817551a447454c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474545 expref: 24 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388048.934832:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945686144 00000100:00100000:2.0:1787388048.934835:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945686144 00010000:00010000:2.0:1787388048.934844:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b74e09000/0x26817551a4474522 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447451b expref: 25 pid: 6514 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388048.934855:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945685888 00000100:00100000:2.0:1787388048.934857:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945685888 00010000:00010000:2.0:1787388048.934866:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a431e4a00/0x26817551a447453e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474537 expref: 26 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388048.934875:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945686016 00000100:00100000:2.0:1787388048.934877:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945686016 00010000:00010000:2.0:1787388048.934897:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b74e08c00/0x26817551a4474530 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474529 expref: 27 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388048.934909:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787388048.934914:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+27:3652:x1874211945685760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388048.934923:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388048.934928:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a431e5200/0x26817551a447454c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474545 expref: 27 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934937:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a431e5200/0x26817551a447454c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474545 expref: 27 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.934951:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388048.934977:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+27:3652:x1874211945685760:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.934983:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787388048.934996:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388048.935001:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+26:3652:x1874211945686144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388048.935007:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388048.935011:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b74e09000/0x26817551a4474522 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447451b expref: 26 pid: 6514 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.935018:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b74e09000/0x26817551a4474522 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a447451b expref: 26 pid: 6514 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.935027:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388048.935046:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+26:3652:x1874211945686144:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.935052:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388048.935068:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787388048.935073:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+25:3649:x1874211945685888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388048.935080:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388048.935084:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a431e4a00/0x26817551a447453e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474537 expref: 25 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.935091:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a431e4a00/0x26817551a447453e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474537 expref: 25 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.935099:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388048.935121:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+25:3649:x1874211945685888:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.935127:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787388048.935138:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787388048.935143:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945686016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388048.935150:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388048.935153:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b74e08c00/0x26817551a4474530 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474529 expref: 24 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.935161:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b74e08c00/0x26817551a4474530 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474529 expref: 24 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388048.935169:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388048.935186:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945686016:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388048.935192:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787388048.935223:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945686016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388048.935231:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945685888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388048.935267:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945686144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388048.935274:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945685760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388048.935773:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e5200/0x26817551a447454c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474545 expref: 23 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388048.935786:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945685120:0@lo:104: 00010000:00010000:0.0:1787388048.935796:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e4a00/0x26817551a447453e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474537 expref: 22 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388048.935804:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945685248:0@lo:104: 00010000:00010000:0.0:1787388048.935813:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e08c00/0x26817551a4474530 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474529 expref: 21 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388048.935821:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945685376:0@lo:104: 00010000:00010000:0.0:1787388048.935829:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09000/0x26817551a4474522 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a447451b expref: 20 pid: 6514 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388048.935846:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945685504:0@lo:104: 00000100:00100000:2.0:1787388048.939827:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388048.939908:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388048.940081:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925675136 00000100:00100000:1.0:1787388048.940090:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925675136 00010000:00010000:1.0:1787388048.940131:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b414a2c00/0x26817551a4474561 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d0e expref: 13 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388048.940169:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925675264 00000100:00100000:1.0:1787388048.940172:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925675264 00010000:00010000:1.0:1787388048.940200:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b414a3400/0x26817551a4474514 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ccf expref: 14 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388048.940219:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:1.0:1787388048.940227:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c26a556f-3215-464e-beb8-43d9848a19a5+14:2402:x1874211925675136:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388048.940241:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388048.940247:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b414a2c00/0x26817551a4474561 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d0e expref: 14 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940257:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b414a2c00/0x26817551a4474561 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d0e expref: 14 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940276:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388048.940333:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c26a556f-3215-464e-beb8-43d9848a19a5+14:2402:x1874211925675136:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 104us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388048.940341:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:1.0:1787388048.940385:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:1.0:1787388048.940393:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925675264:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388048.940401:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388048.940405:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b414a3400/0x26817551a4474514 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ccf expref: 13 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940415:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b414a3400/0x26817551a4474514 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ccf expref: 13 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940428:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940437:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940458:0:7462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940465:0:7462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940471:0:7462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940478:0:7462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940493:0:7462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388048.940498:0:7462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940506:0:7462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940515:0:7462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940524:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388048.940544:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925675264:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 152us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388048.940551:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00010000:00010000:1.0:1787388048.940635:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b414a2c00/0x26817551a4474561 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d0e expref: 12 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388048.940651:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945684992:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388048.940668:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b414a3400/0x26817551a4474514 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ccf expref: 11 pid: 6515 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388048.940677:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874211945685632:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388048.940709:0:13191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940719:0:13191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940724:0:13191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388048.940731:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e08400/0x26817551a4474584 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388049.004806:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388049.645631:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388049.645654:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945686272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388049.645723:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388049.645791:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945686272 00000100:00100000:3.0:1787388049.645805:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945686272 00000100:00100000:3.0:1787388049.645859:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787388049.645868:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945686272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388049.645894:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388049.645935:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945686272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388049.645941:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1787388049.645994:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43836680 x1874211945686272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388049.646010:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945686272:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787388049.646826:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388049.646874:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388049.646886:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945686400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388049.646923:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388049.647210:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945686400 00000100:00100000:3.0:1787388049.647217:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945686400 00000100:00100000:3.0:1787388049.647268:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787388049.647276:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945686400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388049.647293:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388049.647943:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945686400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 664us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388049.647952:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1787388049.648034:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43806680 x1874211945686400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388049.648051:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945686400:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787388049.648118:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787388050.028629:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388050.241578:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388050.242653:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925675392 00000100:00100000:1.0:1787388050.242667:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925675392 00000100:00100000:1.0:1787388050.242724:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 321 00000100:00100000:1.0:1787388050.242734:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+11:6172:x1874211925675392:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388050.242749:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388050.242779:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70077000/0x26817551a447458b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d3f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388050.242807:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077000/0x26817551a447458b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d3f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388050.242819:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70077000/0x26817551a447458b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d3f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388050.242828:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077000, rc 0) 00000100:00100000:1.0:1787388050.242892:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925675392:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 160us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388050.242899:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 321 00000100:00100000:3.0:1787388050.249574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388050.249777:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925675520 00000100:00100000:0.0:1787388050.249787:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925675520 00000100:00100000:0.0:1787388050.249833:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 322 00000100:00100000:0.0:1787388050.249842:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925675520:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388050.249991:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925675520:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 149us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388050.250000:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 322 00000100:00100000:0.0:1787388050.254720:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388050.254850:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925675648 00000100:00100000:3.0:1787388050.254859:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925675648 00000100:00100000:3.0:1787388050.254918:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 323 00000100:00100000:3.0:1787388050.254927:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925675648:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388050.255065:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925675648:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 138us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388050.255073:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 323 00000100:00100000:3.0:1787388050.269842:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388050.270639:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925675776 00000100:00100000:1.0:1787388050.270650:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925675776 00000100:00100000:1.0:1787388050.270709:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 324 00000100:00100000:1.0:1787388050.270720:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925675776:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388050.270736:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388050.270752:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70077200/0x26817551a4474592 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388050.270781:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077200/0x26817551a4474592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d46 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388050.270793:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70077200/0x26817551a4474592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d46 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388050.270803:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077200, rc 0) 00000100:00100000:1.0:1787388050.272410:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:6172:x1874211925675776:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 1682us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388050.272439:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 324 00000100:00100000:0.0:1787388050.282141:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388050.284546:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925675904 00000100:00100000:3.0:1787388050.284559:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925675904 00000100:00100000:3.0:1787388050.284634:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 325 00000100:00100000:3.0:1787388050.284644:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:6172:x1874211925675904:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388050.284804:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:6172:x1874211925675904:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 160us (2671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388050.284826:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 325 00000100:00100000:3.0:1787388050.291434:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388050.291583:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925676032 00000100:00100000:1.0:1787388050.291593:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925676032 00000100:00100000:1.0:1787388050.291902:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 326 00000100:00100000:1.0:1787388050.291912:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:6172:x1874211925676032:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388050.292740:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:6172:x1874211925676032:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 825us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388050.292751:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 326 10000000:01000000:2.0:1787388050.604429:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787388050.604436:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b7f53f000 from 7 10000000:01000000:2.0:1787388050.604441:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388050.604507:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388050.604519:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388050.604530:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388050.604555:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945686528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.604617:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388050.604694:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388050.604825:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945686528 00000100:00100000:0.0:1787388050.604834:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945686528 00000100:00100000:0.0:1787388050.604884:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787388050.604894:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945686528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388050.604907:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388050.604922:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09400/0x26817551a44745a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474599 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388050.604946:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09400/0x26817551a44745a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474599 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388050.604956:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09400/0x26817551a44745a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474599 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388050.604965:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09400, rc 0) 00000100:00100000:0.0:1787388050.605025:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945686528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388050.605047:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787388050.605874:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945686528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388050.605893:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388050.605902:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388050.605989:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945686656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.606026:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388050.606335:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388050.608292:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945686656 00000100:00100000:1.0:1787388050.608314:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945686656 00000100:00100000:1.0:1787388050.608545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787388050.608555:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945686656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388050.608725:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945686656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388050.608733:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787388050.608805:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945686656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.608851:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945686784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.608900:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388050.609215:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388050.613225:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945686784 00000100:00100000:0.0:1787388050.613240:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945686784 00000100:00100000:0.0:1787388050.613318:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787388050.613329:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945686784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388050.613841:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945686784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 513us (4939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388050.613850:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787388050.614229:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945686784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787388050.617910:0:13223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787388050.618565:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787388050.618589:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787388050.618600:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388050.618612:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388050.618623:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787388050.618626:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b74ea1800 from 7 10000000:01000000:2.0:1787388050.618629:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388050.618666:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388050.618674:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388050.618685:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388050.618720:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945686912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.618781:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388050.618822:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388050.618887:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945686912 00000100:00100000:0.0:1787388050.618894:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945686912 00000100:00100000:0.0:1787388050.618936:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787388050.618945:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945686912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388050.618957:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388050.618971:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e08c00/0x26817551a44745ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44745a7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388050.619006:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e08c00/0x26817551a44745ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44745a7 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388050.619016:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e08c00/0x26817551a44745ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44745a7 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388050.619024:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08c00, rc 0) 00000100:00100000:0.0:1787388050.619069:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945686912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388050.619086:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787388050.619279:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945686912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388050.619293:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388050.619315:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388050.619385:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.619411:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388050.619432:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388050.620185:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945687040 00000100:00100000:1.0:1787388050.620192:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945687040 00000100:00100000:1.0:1787388050.620223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787388050.620231:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945687040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388050.620379:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945687040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388050.620386:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787388050.620696:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.620732:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.620782:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388050.620814:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388050.621173:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945687168 00000100:00100000:1.0:1787388050.621179:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945687168 00000100:00100000:1.0:1787388050.621264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787388050.621273:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945687168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388050.621422:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945687168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388050.621429:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787388050.621749:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787388050.627818:0:13224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787388050.628111:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787388050.628133:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388050.628202:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388050.628275:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388050.628289:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787388050.628291:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b73aa7800 from 7 10000000:01000000:3.0:1787388050.628294:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388050.629046:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388050.629062:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388050.629093:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388050.629119:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43836680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.629195:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388050.629376:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945687296 00000100:00100000:3.0:1787388050.629384:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945687296 00000100:00100000:3.0:1787388050.629436:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787388050.629437:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365780 going to sleep for 11 seconds 00000100:00100000:3.0:1787388050.629449:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945687296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388050.629480:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388050.629495:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f7c00/0x26817551a44745bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44745b5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388050.629520:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f7c00/0x26817551a44745bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44745b5 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388050.629533:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f7c00/0x26817551a44745bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44745b5 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388050.629543:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7c00, rc 0) 00000100:00100000:3.0:1787388050.629592:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945687296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388050.629607:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787388050.629646:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43836680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388050.629662:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388050.629671:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388050.629730:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.629757:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388050.629784:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365780 going to sleep for 11 seconds 00000100:00100000:3.0:1787388050.629854:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945687424 00000100:00100000:3.0:1787388050.629860:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945687424 00000100:00100000:3.0:1787388050.629897:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787388050.629904:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945687424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388050.630021:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945687424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388050.630029:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787388050.631128:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.631178:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.631235:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388050.631266:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365780 going to sleep for 11 seconds 00000100:00100000:2.0:1787388050.631289:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945687552 00000100:00100000:2.0:1787388050.631294:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945687552 00000100:00100000:2.0:1787388050.631359:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787388050.631368:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945687552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388050.631681:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945687552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 313us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388050.631698:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787388050.631756:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787388050.639096:0:13226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787388050.640589:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787388050.640626:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388050.640640:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388050.640654:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388050.640666:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787388050.640668:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b46a34000 from 7 10000000:01000000:3.0:1787388050.640671:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787388050.640712:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388050.640721:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388050.640733:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388050.640760:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787388050.640838:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388050.640879:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42260d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787388050.641193:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945687680 00000100:00100000:0.0:1787388050.641202:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945687680 00000100:00100000:0.0:1787388050.641259:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787388050.641268:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945687680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388050.641283:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388050.641297:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09000/0x26817551a44745ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44745c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388050.641336:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09000/0x26817551a44745ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44745c3 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388050.641372:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09000/0x26817551a44745ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44745c3 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388050.641380:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09000, rc 0) 00000100:00100000:0.0:1787388050.641433:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945687680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388050.641441:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787388050.641588:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388050.641603:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388050.641611:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388050.641667:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388050.641696:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388050.641716:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b584263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388050.641729:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945687808 00000100:00100000:1.0:1787388050.641732:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945687808 00000100:00100000:1.0:1787388050.642170:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787388050.642180:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945687808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388050.642305:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945687808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388050.642313:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787388050.642367:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388050.642398:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388050.642442:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388050.644191:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945687936 00000100:00100000:0.0:1787388050.644203:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945687936 00000100:00100000:0.0:1787388050.644243:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787388050.644251:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945687936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388050.644417:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945687936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388050.644425:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787388050.644643:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b584263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388050.644666:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945687936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787388050.653280:0:13227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787388050.654172:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787388050.654196:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787388050.654207:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388050.654220:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388051.065268:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388051.692649:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388051.692674:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945688064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388051.692749:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388051.692823:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945688064 00000100:00100000:0.0:1787388051.692830:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945688064 00000100:00100000:0.0:1787388051.692877:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787388051.692886:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945688064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388051.692920:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787388051.692965:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945688064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388051.692972:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787388051.693018:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945688064:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787388052.082281:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388052.716483:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388052.716505:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945688192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388052.716583:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388052.716653:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945688192 00000100:00100000:0.0:1787388052.716660:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945688192 00000100:00100000:0.0:1787388052.716710:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787388052.716720:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945688192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388052.716748:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388052.716789:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945688192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388052.716796:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1787388052.716816:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787388052.716846:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a41c54e00 x1874211945688192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388052.716863:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a41c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945688192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388052.717159:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945688320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388052.717189:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388052.717474:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945688320 00000100:00100000:0.0:1787388052.717486:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945688320 00000100:00100000:0.0:1787388052.717528:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787388052.717535:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945688320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388052.717547:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388052.717582:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945688320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388052.717589:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1787388052.717618:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43934380 x1874211945688320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388052.717631:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945688320:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787388052.717683:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388052.718392:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945688704:0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.718431:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388052.718454:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945689216:0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.718478:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388052.718495:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945689728:0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.718513:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388052.718535:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787388052.718541:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945688832:0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.718562:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388052.718579:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945689344:0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.718600:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388052.718627:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945688704 00000100:00100000:1.0:1787388052.718632:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945688704 00000100:00100000:1.0:1787388052.718670:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787388052.718677:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945688704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.718719:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945688704:12345-0@lo:400:kworker.0 Request processed in 42us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388052.718725:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787388052.718743:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945689216 00000100:00100000:1.0:1787388052.718747:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945689216 00000100:00100000:1.0:1787388052.718774:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945689728 00000100:00100000:1.0:1787388052.718777:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945689728 00000100:00100000:1.0:1787388052.718790:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945688832 00000100:00100000:1.0:1787388052.718792:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945688832 00000100:00100000:1.0:1787388052.718804:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787388052.718810:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945689216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.718838:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945689216:12345-0@lo:400:kworker.0 Request processed in 29us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388052.718844:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787388052.718855:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787388052.718861:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945689728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.718883:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945689728:12345-0@lo:400:kworker.0 Request processed in 23us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388052.718888:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787388052.718897:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787388052.718902:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945688832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.718924:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945688832:12345-0@lo:400:kworker.0 Request processed in 23us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388052.718929:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787388052.718948:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945689344 00000100:00100000:1.0:1787388052.718957:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945689344 00000100:00100000:1.0:1787388052.718983:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787388052.718990:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945689344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.719020:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945689344:12345-0@lo:400:kworker.0 Request processed in 31us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388052.719027:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787388052.719047:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388052.719051:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388052.719073:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945688832:0@lo:400:kworker.0 00010000:00080000:1.0:1787388052.719085:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58ca80 x1874211945689344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388052.719094:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945689344:0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.719118:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945688704:0@lo:400:kworker.0 00010000:00080000:1.0:1787388052.719129:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223ed80 x1874211945689216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388052.719138:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945689216:0@lo:400:kworker.0 00010000:00080000:1.0:1787388052.719212:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43379180 x1874211945689728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388052.719221:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945689728:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.720256:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945688576:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.720319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388052.720365:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945689088:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.720390:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388052.720412:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945689600:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.720432:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388052.720452:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787388052.720457:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945688448:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.720481:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388052.720499:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945688960:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.720517:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388052.720529:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945689472:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.720545:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388052.720571:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945689472 00000100:00100000:2.0:1787388052.720576:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945689472 00000100:00100000:2.0:1787388052.720618:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787388052.720626:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945689472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.720666:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945689472:12345-0@lo:400:kworker.0 Request processed in 41us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388052.720673:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1787388052.720707:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43378000 x1874211945689472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388052.720732:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945689472:0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.720891:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945688576 00000100:00100000:1.0:1787388052.720896:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945688576 00000100:00100000:1.0:1787388052.720915:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945689088 00000100:00100000:1.0:1787388052.720918:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945689088 00000100:00100000:1.0:1787388052.720931:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945689600 00000100:00100000:1.0:1787388052.720933:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945689600 00000100:00100000:1.0:1787388052.720956:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787388052.720962:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945688576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.721011:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945688576:12345-0@lo:400:kworker.0 Request processed in 48us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388052.721018:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787388052.721029:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787388052.721035:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945689088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.721061:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945689088:12345-0@lo:400:kworker.0 Request processed in 27us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388052.721067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787388052.721077:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787388052.721082:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945689600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388052.721117:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945689600:12345-0@lo:400:kworker.0 Request processed in 35us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388052.721123:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:1.0:1787388052.721141:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388052.721247:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388052.721774:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945688960 00000100:00100000:0.0:1787388052.721780:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945688960 00000100:00100000:0.0:1787388052.721821:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787388052.721829:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945688960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388052.721871:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945688960:12345-0@lo:400:kworker.0 Request processed in 43us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388052.721877:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787388052.721898:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945688448 00000100:00100000:0.0:1787388052.721902:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945688448 00000100:00100000:0.0:1787388052.721928:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787388052.721934:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945688448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388052.721964:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945688448:12345-0@lo:400:kworker.0 Request processed in 30us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388052.721970:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787388052.722067:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945688448:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.722079:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945688960:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.722090:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945688576:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.722099:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945689088:0@lo:400:kworker.0 00000100:00100000:2.0:1787388052.722122:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945689600:0@lo:400:kworker.0 00010000:00010000:0.0:1787388053.100999:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787388053.448258:0:13391:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787388053.741521:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388053.741543:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945689856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388053.741626:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388053.746251:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945689856 00000100:00100000:1.0:1787388053.746266:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945689856 00000100:00100000:1.0:1787388053.746415:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787388053.746425:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945689856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388053.746588:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388053.746676:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945689856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 253us (5050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388053.746684:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787388053.746810:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945689856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388053.767117:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388053.767144:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388053.767181:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388053.767200:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388053.767220:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388053.767248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925676288 00000100:00100000:0.0:1787388053.767258:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925676288 00000100:00100000:0.0:1787388053.767317:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925676544 00000100:00100000:0.0:1787388053.767321:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925676544 00000100:00100000:0.0:1787388053.767334:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925676416 00000100:00100000:0.0:1787388053.767336:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925676416 00000100:00100000:0.0:1787388053.767366:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925676672 00000100:00100000:0.0:1787388053.767368:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925676672 00000100:00100000:0.0:1787388053.767387:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 217 00000100:00100000:0.0:1787388053.767395:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925676288:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388053.767635:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 218 00000100:00100000:3.0:1787388053.767645:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925676544:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388053.767681:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925676544:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 38us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388053.767689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 218 00000100:00100000:3.0:1787388053.767707:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 219 00000100:00100000:3.0:1787388053.767714:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925676416:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388053.767738:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925676416:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388053.767745:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 219 00000100:00100000:3.0:1787388053.767757:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 220 00000100:00100000:3.0:1787388053.767763:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925676672:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388053.767785:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925676672:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 22us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388053.767791:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 220 00000100:00100000:3.0:1787388053.767807:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925676160 00000100:00100000:3.0:1787388053.767811:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925676160 00000100:00100000:3.0:1787388053.767886:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 340 00000100:00100000:3.0:1787388053.767893:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925676160:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388053.767917:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925676160:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388053.767923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 340 00000100:00100000:0.0:1787388053.768380:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925676288:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 983us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388053.768387:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 217 00000100:00080000:1.0:1787388053.768565:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388053.768575:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787388054.125167:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388054.764583:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388054.764644:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945689984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388054.764706:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388054.764948:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945689984 00000100:00100000:0.0:1787388054.764956:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945689984 00000100:00100000:0.0:1787388054.765012:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787388054.765022:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945689984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388054.765068:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388054.765113:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945689984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388054.765119:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1787388054.765155:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d99c00 x1874211945689984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388054.765188:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945689984:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787388054.765381:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388054.769293:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388054.769316:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945690112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388054.769398:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388054.769466:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945690112 00000100:00100000:1.0:1787388054.769475:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945690112 00000100:00100000:1.0:1787388054.769528:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787388054.769537:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945690112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388054.769559:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388054.769599:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945690112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388054.769606:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1787388054.769625:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787388054.769652:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43379180 x1874211945690112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388054.769671:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945690112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787388055.151698:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388056.184496:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388056.812772:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388056.812802:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945690240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388056.812878:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388056.812952:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945690240 00000100:00100000:2.0:1787388056.812959:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945690240 00000100:00100000:2.0:1787388056.813006:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787388056.813014:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945690240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388056.813050:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388056.813098:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945690240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388056.813117:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787388056.813265:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945690240:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388057.197388:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388057.836613:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945690496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388057.836735:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945690752:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.837165:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388057.837226:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945691264:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.837294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388057.837325:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b49a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945691776:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.837371:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388057.837402:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787388057.837409:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945690368:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.837438:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388057.837460:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945690880:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.837489:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388057.837504:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945691392:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.837539:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388057.837554:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b49a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945691904:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.837572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388057.837601:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945691264 00000100:00100000:1.0:1787388057.837608:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945691264 00000100:00100000:1.0:1787388057.837651:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945691776 00000100:00100000:1.0:1787388057.837654:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945691776 00000100:00100000:1.0:1787388057.837667:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945690880 00000100:00100000:1.0:1787388057.837669:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945690880 00000100:00100000:1.0:1787388057.837683:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787388057.837690:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945691264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.837736:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945691264:12345-0@lo:400:kworker.0 Request processed in 46us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388057.837744:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787388057.837760:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787388057.837766:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945691776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388057.837886:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945690752 00000100:00100000:2.0:1787388057.837891:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945690752 00000100:00100000:2.0:1787388057.837922:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787388057.837929:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945690752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388057.837977:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945690752:12345-0@lo:400:kworker.0 Request processed in 48us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388057.837983:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1787388057.838023:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388057.838035:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945691392 00000100:00100000:2.0:1787388057.838038:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945691392 00000100:00100000:2.0:1787388057.838078:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945691904 00000100:00100000:2.0:1787388057.838081:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945691904 00000100:00100000:0.0:1787388057.838088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388057.838099:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787388057.838104:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945691392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388057.838117:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945691008:0@lo:400:kworker.0 00000100:00100000:2.0:1787388057.838133:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945691392:12345-0@lo:400:kworker.0 Request processed in 29us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388057.838139:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787388057.838150:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787388057.838156:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945691904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388057.838282:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945690624:0@lo:400:kworker.0 00000100:00100000:2.0:1787388057.845311:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945691904:12345-0@lo:400:kworker.0 Request processed in 7145us (7728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388057.845327:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787388057.845400:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787388057.845414:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945690880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388057.845489:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945690880:12345-0@lo:400:kworker.0 Request processed in 81us (7998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388057.845495:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787388057.845521:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945690368 00000100:00100000:2.0:1787388057.845529:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945690368 00000100:00100000:2.0:1787388057.847186:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787388057.847196:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945690368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388057.847273:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945690368:12345-0@lo:400:kworker.0 Request processed in 79us (9833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388057.847281:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:2.0:1787388057.847327:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787388057.847333:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388057.847391:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945690496 00000100:00100000:2.0:1787388057.847398:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945690496 00000100:00100000:2.0:1787388057.847432:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787388057.847438:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945690496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388057.847460:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388057.847494:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945690496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (9406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388057.847499:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1787388057.847515:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388057.847558:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945690368:0@lo:400:kworker.0 00000100:00100000:2.0:1787388057.847574:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945690880:0@lo:400:kworker.0 00010000:00080000:2.0:1787388057.847586:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223e680 x1874211945691392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388057.847595:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945691392:0@lo:400:kworker.0 00010000:00080000:2.0:1787388057.847623:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b49a82680 x1874211945691904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388057.847633:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b49a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945691904:0@lo:400:kworker.0 00000100:00100000:2.0:1787388057.847644:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945690752:0@lo:400:kworker.0 00010000:00080000:2.0:1787388057.847655:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223ed80 x1874211945691264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388057.847662:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945691264:0@lo:400:kworker.0 00000100:00100000:3.0:1787388057.847893:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388057.847922:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945691136:0@lo:400:kworker.0 00000100:00100000:3.0:1787388057.848305:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388057.848337:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945690624 00000100:00100000:3.0:1787388057.848341:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945690624 00000100:00100000:3.0:1787388057.848382:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945691136 00000100:00100000:3.0:1787388057.848385:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945691136 00000100:00100000:3.0:1787388057.848407:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787388057.848422:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945690624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388057.848465:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945690624:12345-0@lo:400:kworker.0 Request processed in 51us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388057.848471:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787388057.848482:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787388057.848488:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945691136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388057.848513:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945691136:12345-0@lo:400:kworker.0 Request processed in 26us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388057.849573:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:3.0:1787388057.849610:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388057.849643:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945691136:0@lo:400:kworker.0 00000100:00100000:3.0:1787388057.849654:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b49a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945691648:0@lo:400:kworker.0 00000100:00100000:3.0:1787388057.849709:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388057.849736:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945691648 00000100:00100000:3.0:1787388057.850029:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945691648 00000100:00100000:3.0:1787388057.850065:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787388057.850072:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945691648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388057.850204:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945691648:12345-0@lo:400:kworker.0 Request processed in 132us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388057.850211:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:2.0:1787388057.850257:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388057.850343:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b49a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945691648:0@lo:400:kworker.0 00000100:00100000:2.0:1787388057.850370:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945692160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388057.850407:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388057.850479:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945690624:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.856709:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945692160 00000100:00100000:0.0:1787388057.856729:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388057.856733:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945692160 00000100:00100000:0.0:1787388057.856795:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945691008 00000100:00100000:1.0:1787388057.856801:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787388057.856802:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945691008 00000100:00100000:1.0:1787388057.856814:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945692160:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388057.856842:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787388057.856850:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945691008:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787388057.856866:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388057.856933:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945692160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (6525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388057.856941:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787388057.857009:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945691776:12345-0@lo:400:kworker.0 Request processed in 19241us (19660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388057.857018:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00010000:00080000:1.0:1787388057.857058:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b49a80a80 x1874211945691776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388057.857074:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b49a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945691776:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.857198:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b49a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945691520:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.857233:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388057.857266:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945691520 00000100:00100000:1.0:1787388057.857270:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945691520 00000100:00100000:1.0:1787388057.857303:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787388057.857309:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945691520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.857340:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945691520:12345-0@lo:400:kworker.0 Request processed in 31us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388057.857369:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1787388057.857399:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b49a80700 x1874211945691520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388057.857401:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945691008:12345-0@lo:400:kworker.0 Request processed in 550us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388057.857418:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787388057.857421:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b49a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945691520:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.857431:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b49a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945692032:0@lo:400:kworker.0 00000100:00100000:1.0:1787388057.857456:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787388057.857517:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43935500 x1874211945690496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388057.857532:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945690496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388057.857556:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945691008:0@lo:400:kworker.0 00000100:00080000:2.0:1787388057.859313:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388057.859364:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945692032 00000100:00100000:2.0:1787388057.859373:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945692032 00000100:00100000:2.0:1787388057.859425:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787388057.859435:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945692032:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787388057.859553:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58b800 x1874211945692160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388057.859574:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945692160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388057.859634:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945692032:12345-0@lo:400:kworker.0 Request processed in 200us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388057.859642:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1787388057.859676:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b49a82d80 x1874211945692032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388057.859688:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b49a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945692032:0@lo:400:kworker.0 00010000:00010000:2.0:1787388058.220888:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388058.863224:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388058.863257:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945692288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388058.863323:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388058.863653:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945692288 00000100:00100000:0.0:1787388058.863662:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945692288 00000100:00100000:0.0:1787388058.863708:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787388058.863724:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945692288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388058.863763:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388058.863857:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945692288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388058.863864:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787388058.864142:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945692288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388058.891169:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388058.891217:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388058.891254:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388058.891277:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388058.891298:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388058.891368:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925676928 00000100:00100000:1.0:1787388058.891378:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925676928 00000100:00100000:2.0:1787388058.891887:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925677184 00000100:00100000:2.0:1787388058.891893:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925677184 00000100:00100000:2.0:1787388058.891923:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925677056 00000100:00100000:2.0:1787388058.891925:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925677056 00000100:00100000:2.0:1787388058.891937:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925677312 00000100:00100000:2.0:1787388058.891939:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925677312 00000100:00100000:2.0:1787388058.891954:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 227 00000100:00100000:2.0:1787388058.891963:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925677184:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388058.892098:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 228 00000100:00100000:1.0:1787388058.892107:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925677056:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388058.892171:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925677056:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 61us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.892180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 228 00000100:00100000:1.0:1787388058.892198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 229 00000100:00100000:1.0:1787388058.892205:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925677312:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388058.892717:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787388058.892728:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787388058.892746:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925676800 00000100:00100000:3.0:1787388058.892751:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925676800 00000100:00100000:3.0:1787388058.892783:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 342 00000100:00100000:3.0:1787388058.892789:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925676800:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388058.894965:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925677184:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 2991us (3736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388058.895218:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 227 00000100:00100000:2.0:1787388058.895261:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 230 00000100:00100000:2.0:1787388058.895275:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2400:x1874211925676928:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388058.895337:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2400:x1874211925676928:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 69us (4175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388058.895343:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 230 00000100:00080000:2.0:1787388058.895385:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388058.895459:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388058.896294:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925677312:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 4084us (4989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388058.896304:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 229 00000100:00100000:3.0:1787388058.896748:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925676800:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 3955us (5490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388058.896759:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 342 00010000:00010000:3.0:1787388059.244629:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787388059.350665:0:13540:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:40:57 (1787388057) === 00000100:00100000:3.0:1787388059.551513:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388059.551554:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388059.551669:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925677568 00000100:00100000:1.0:1787388059.551679:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925677568 00000100:00100000:2.0:1787388059.551844:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925677440 00000100:00100000:2.0:1787388059.551848:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925677440 00000100:00100000:2.0:1787388059.551885:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:2.0:1787388059.551894:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2400:x1874211925677440:12345-192.168.203.15@tcp:41:mkdir.0 00000004:00000024:2.0:1787388059.551934:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388059.552035:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2400:x1874211925677440:12345-192.168.203.15@tcp:41:mkdir.0 Request processed in 141us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388059.552060:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:1.0:1787388059.552261:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:1.0:1787388059.552271:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:00e97fed-41ea-4716-be07-f037d23906cf+6:10524:x1874211925677568:12345-192.168.203.15@tcp:700:mkdir.0 00000100:00100000:1.0:1787388059.552318:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:00e97fed-41ea-4716-be07-f037d23906cf+6:10524:x1874211925677568:12345-192.168.203.15@tcp:700:mkdir.0 Request processed in 48us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388059.552325:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:3.0:1787388059.558824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388059.562504:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925677824 00000100:00100000:0.0:1787388059.562519:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925677824 00000100:00100000:0.0:1787388059.562981:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:0.0:1787388059.562994:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:10524:x1874211925677824:12345-192.168.203.15@tcp:36:mkdir.0 00010000:00010000:0.0:1787388059.563058:0:10197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388059.563109:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a4474473 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cba expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563132:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b4555d800) 00010000:00010000:0.0:1787388059.563156:0:10197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388059.563249:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563263:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563273:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563299:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563306:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563327:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563798:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563807:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563815:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388059.563826:0:10197:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a015dc24 reply state 000000001f0291bc transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563847:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563853:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0bf00) 00010000:00010000:0.0:1787388059.563856:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388059.563858:0:10197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787388059.563863:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787388059.563868:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563875:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563882:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563887:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388059.563897:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563905:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745d1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563913:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d0b100) 00010000:00010000:0.0:1787388059.563915:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388059.563918:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563925:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388059.563937:0:10197:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a015dc24 reply state 000000001f0291bc transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563945:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.563950:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996b74d0ba00) 00010000:00010000:0.0:1787388059.563952:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388059.563954:0:10197:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787388059.564041:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+7:10524:x1874211925677824:12345-192.168.203.15@tcp:36:mkdir.0 Request processed in 1049us (5224us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787388059.564049:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1787388059.572583:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388059.572643:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925677952 00000100:00100000:1.0:1787388059.572652:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925677952 00000100:00100000:1.0:1787388059.572707:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:1.0:1787388059.572715:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+7:10525:x1874211925677952:12345-192.168.203.15@tcp:101:chmod.0 00010000:00010000:1.0:1787388059.572737:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388059.572763:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44745e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d4d expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.572841:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a44745ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.572855:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a44745ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.572865:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a44745ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388059.572910:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388059.572913:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388059.572941:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a44745ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.572965:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44745e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d4d expref: 9 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.572982:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a44745ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d4d expref: 8 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.572991:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b728f5900) 00010000:00010000:1.0:1787388059.572994:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388059.572997:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076400, rc 0) 00000100:00100000:1.0:1787388059.573065:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+8:10525:x1874211925677952:12345-192.168.203.15@tcp:101:chmod.0 Request processed in 350us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388059.573073:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:1.0:1787388059.576104:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388059.576452:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925678208 00000100:00100000:2.0:1787388059.576465:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925678208 00000100:00100000:2.0:1787388059.576549:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:2.0:1787388059.576561:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:10525:x1874211925678208:12345-192.168.203.15@tcp:36:chmod.0 00010000:00010000:2.0:1787388059.576630:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388059.576664:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a44745ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d4d expref: 8 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.576686:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b728f5900) 00010000:00010000:2.0:1787388059.576699:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388059.576731:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.576746:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.576758:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388059.577025:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4a86da9 reply state 00000000ade99f4d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.577041:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.577047:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595100) 00010000:00010000:2.0:1787388059.577050:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787388059.577330:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787388059.577342:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787388059.577693:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+9:10525:x1874211925678208:12345-192.168.203.15@tcp:36:chmod.0 Request processed in 1131us (1599us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787388059.577703:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:3.0:1787388059.607946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388059.608189:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925678336 00000100:00100000:0.0:1787388059.608202:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925678336 00000100:00100000:0.0:1787388059.608290:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:0.0:1787388059.608304:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+9:10526:x1874211925678336:12345-192.168.203.15@tcp:101:chown.0 00010000:00010000:0.0:1787388059.608333:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388059.608425:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d54 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.608524:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09200/0x26817551a4474602 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.608541:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09200/0x26817551a4474602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.608555:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09200/0x26817551a4474602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388059.608610:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787388059.608614:0:10197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388059.608656:0:10197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09200/0x26817551a4474602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.608809:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44745fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d54 expref: 11 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.608834:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09200/0x26817551a4474602 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d54 expref: 10 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.608844:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595100) 00010000:00010000:0.0:1787388059.608848:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388059.608853:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09200, rc 0) 00000100:00100000:0.0:1787388059.608935:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+10:10526:x1874211925678336:12345-192.168.203.15@tcp:101:chown.0 Request processed in 635us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388059.608944:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:2.0:1787388059.614899:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388059.615207:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925678464 00000100:00100000:1.0:1787388059.615250:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925678464 00000100:00100000:1.0:1787388059.615325:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:1.0:1787388059.615336:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+10:10526:x1874211925678464:12345-192.168.203.15@tcp:101:chown.0 00010000:00010000:1.0:1787388059.615405:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388059.615438:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474609 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d5b expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.616307:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474610 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.616329:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474610 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.616343:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474610 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.616379:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474617 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.616387:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.616395:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.616968:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447461e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.616980:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447461e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.616989:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447461e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388059.617329:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388059.617335:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388059.617392:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447461e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.617842:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474610 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.617852:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474610 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.617860:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474610 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.617931:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388059.617936:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474610 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.617944:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474610 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.617963:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595100) 00010000:00010000:1.0:1787388059.617967:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388059.617972:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474610 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.617978:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474610 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.617995:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.618145:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474617 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.618152:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474617 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.618158:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388059.618217:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474617 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.618225:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474617 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.618235:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996b74d0ba00) 00010000:00010000:1.0:1787388059.618247:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388059.618251:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474617 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.618257:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474617 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.618303:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474609 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d5b expref: 12 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.618320:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447461e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d5b expref: 11 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.618327:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0bf00) 00010000:00010000:1.0:1787388059.618330:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388059.618339:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077c00, rc 0) 00000100:00100000:1.0:1787388059.619437:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+11:10526:x1874211925678464:12345-192.168.203.15@tcp:101:chown.0 Request processed in 4092us (4542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388059.619451:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:1.0:1787388059.628471:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388059.628834:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925678592 00000100:00100000:3.0:1787388059.628865:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925678592 00000100:00100000:3.0:1787388059.628991:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:3.0:1787388059.629003:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:00e97fed-41ea-4716-be07-f037d23906cf+11:10526:x1874211925678592:12345-192.168.203.15@tcp:900:chown.0 00000100:00100000:3.0:1787388059.629127:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:00e97fed-41ea-4716-be07-f037d23906cf+11:10526:x1874211925678592:12345-192.168.203.15@tcp:900:chown.0 Request processed in 126us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388059.629137:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:3.0:1787388059.634750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388059.638640:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925678848 00000100:00100000:2.0:1787388059.638662:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925678848 00000100:00100000:2.0:1787388059.638889:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:2.0:1787388059.638903:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+11:10526:x1874211925678848:12345-192.168.203.15@tcp:36:chown.0 00010000:00010000:2.0:1787388059.638976:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388059.639010:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447461e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d5b expref: 11 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.639050:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0bf00) 00010000:00010000:2.0:1787388059.639065:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388059.639098:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.639114:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.639125:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388059.658577:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1787388059.658820:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000401397d1 reply state 00000000886ccba5 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.658842:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.658851:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0bf00) 00010000:00010000:3.0:1787388059.658855:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787388059.658858:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787388059.658871:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1787388059.658978:0:6521:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787388059.658999:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+9:10526:x1874211925678848:12345-192.168.203.15@tcp:36:chown.0 Request processed in 20095us (24326us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787388059.659009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00010000:00010000:3.0:1787388059.659077:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.659087:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.659093:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.659117:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388059.659122:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.659129:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.659140:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0bf00) 00010000:00010000:3.0:1787388059.659143:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787388059.659146:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.659152:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4474625 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659335:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659381:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659401:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659407:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388059.659410:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659417:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659427:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996b74d0ba00) 00010000:00010000:2.0:1787388059.659429:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388059.659432:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659437:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08400/0x26817551a44745d8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659453:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659460:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659466:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659470:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08e00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388059.659473:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659489:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659498:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0bf00) 00010000:00010000:2.0:1787388059.659500:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388059.659503:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659509:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a44745df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659524:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659530:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659536:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659541:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388059.659544:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659550:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659559:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595100) 00010000:00010000:2.0:1787388059.659561:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787388059.659564:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.659580:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4000/0x26817551a44745f4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388059.679132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388059.679247:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925678976 00000100:00100000:1.0:1787388059.679258:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925678976 00000100:00100000:1.0:1787388059.679322:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:1.0:1787388059.679332:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:10527:x1874211925678976:12345-192.168.203.15@tcp:101:touch.500 00010000:00010000:1.0:1787388059.679403:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388059.679429:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a447462c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d62 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787388059.681531:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2049us 00010000:00010000:0.0:1787388059.716614:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a4474633 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716644:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a4474633 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716655:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a4474633 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716672:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447463a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716679:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447463a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716686:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447463a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716882:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4474641 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716891:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4474641 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716898:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4474641 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388059.716927:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787388059.716930:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388059.716961:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4474641 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716973:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a4474633 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716988:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a4474633 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.716995:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a4474633 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717000:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388059.717004:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a4474633 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717011:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a4474633 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717022:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595100) 00010000:00010000:0.0:1787388059.717025:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388059.717029:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a4474633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717036:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a4474633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717047:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447463a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717052:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447463a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717058:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447463a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717063:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388059.717070:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447463a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717076:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447463a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717083:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996b74d0b100) 00010000:00010000:0.0:1787388059.717085:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388059.717088:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447463a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717093:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447463a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717126:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a447462c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d62 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717139:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4474641 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d62 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.717146:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:0.0:1787388059.717147:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787388059.717149:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08e00, rc 0) 00000100:00100000:0.0:1787388059.717262:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:10527:x1874211925678976:12345-192.168.203.15@tcp:101:touch.500 Request processed in 37931us (38138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388059.717270:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:1.0:1787388059.744257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388059.747527:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925679232 00000100:00100000:3.0:1787388059.747542:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925679232 00000100:00100000:3.0:1787388059.747601:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:3.0:1787388059.747610:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+7:10527:x1874211925679232:12345-192.168.203.15@tcp:101:touch.500 00010000:00010000:3.0:1787388059.747630:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388059.747650:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474648 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d69 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.747766:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a447464f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.747916:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a447464f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.747942:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a447464f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.747982:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.747989:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.747996:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787388059.748953:0:13515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787388059.749108:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a447465d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749118:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a447465d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749126:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a447465d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749158:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a447464f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749165:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a447464f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749170:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a447464f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749175:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388059.749187:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a447464f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749194:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a447464f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749204:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:3.0:1787388059.749207:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388059.749211:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a447464f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749217:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a447464f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388059.749230:0:13515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e7f1af2 reply state 00000000702c178a transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749253:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749259:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xfcf4bd8d (ffff996a43284500) 00010000:00010000:3.0:1787388059.749262:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388059.749264:0:13515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787388059.749300:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474648 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d69 expref: 10 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749315:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a447465d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d69 expref: 9 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.749321:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff996a43284c00) 00010000:00010000:3.0:1787388059.749323:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388059.749331:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7a00, rc 0) 00000100:00100000:3.0:1787388059.750663:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+10:10527:x1874211925679232:12345-192.168.203.15@tcp:101:touch.500 Request processed in 3046us (6416us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787388059.750675:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:3.0:1787388059.774954:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388059.775128:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925679488 00000100:00100000:2.0:1787388059.775139:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925679488 00000100:00100000:2.0:1787388059.775192:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:2.0:1787388059.775202:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+10:10527:x1874211925679488:12345-192.168.203.15@tcp:36:touch.500 00010000:00010000:2.0:1787388059.775267:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388059.775295:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a447465d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d69 expref: 10 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.775315:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff996a43284c00) 00010000:00010000:2.0:1787388059.775326:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388059.775427:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.775440:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.775451:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388059.775553:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019e61127 reply state 00000000623ec914 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.775566:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388059.775590:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff996b58595c00) 00010000:00010000:2.0:1787388059.775593:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388059.775595:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388059.775693:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+11:10527:x1874211925679488:12345-192.168.203.15@tcp:36:touch.500 Request processed in 492us (746us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787388059.775702:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:2.0:1787388059.781978:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388059.782227:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925679616 00000100:00100000:0.0:1787388059.782247:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925679616 00000100:00100000:0.0:1787388059.782309:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:0.0:1787388059.782320:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+11:10527:x1874211925679616:12345-192.168.203.15@tcp:101:touch.500 00010000:00010000:0.0:1787388059.782386:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388059.782414:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4474672 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d70 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.782467:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4474672 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d70 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.782482:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4474672 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d70 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388059.782499:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff996b58595c00) 00010000:00010000:0.0:1787388059.782503:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787388059.782506:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08000, rc 0) 00000100:00100000:0.0:1787388059.782562:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+12:10527:x1874211925679616:12345-192.168.203.15@tcp:101:touch.500 Request processed in 244us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388059.782569:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:3.0:1787388059.787563:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388059.787705:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925679744 00000100:00100000:2.0:1787388059.787715:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925679744 00000100:00100000:2.0:1787388059.787751:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:2.0:1787388059.787760:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874211925679744:12345-192.168.203.15@tcp:8:touch.500 00010000:00080000:2.0:1787388059.787802:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:2.0:1787388059.787835:0:8437:0:(genops.c:1406:class_connect()) connect: client 00e97fed-41ea-4716-be07-f037d23906cf, cookie 0x26817551a4474679 00002000:00100000:2.0:1787388059.787845:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 00e97fed-41ea-4716-be07-f037d23906cf/ffff996a43316000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787388059.787861:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787388059.787932:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787388059.787960:0:8437:0:(import.c:65:import_set_state_nolock()) ffff996a43315000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388059.788038:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2398:x1874211925679744:12345-192.168.203.15@tcp:8:touch.500 Request processed in 278us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388059.788046:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:2.0:1787388059.792795:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388059.794923:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925679872 00000100:00100000:0.0:1787388059.794935:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925679872 00000100:00100000:0.0:1787388059.795021:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1787388059.795031:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:0:x1874211925679872:12345-192.168.203.15@tcp:2:touch.500 00000100:00080000:2.0:1787388059.795455:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787388059.805957:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1787388059.805971:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000100:00100000:0.0:1787388059.807340:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:0:x1874211925679872:12345-192.168.203.15@tcp:2:touch.500 Request processed in 12302us (14555us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787388059.807393:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:3.0:1787388059.827765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388059.830036:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925680128 00000100:00100000:0.0:1787388059.830049:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925680128 00000100:00100000:0.0:1787388059.830118:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:0.0:1787388059.830130:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+12:10527:x1874211925680128:12345-192.168.203.15@tcp:35:touch.500 00000100:00100000:0.0:1787388059.830489:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+13:10527:x1874211925680128:12345-192.168.203.15@tcp:35:touch.500 Request processed in 360us (2734us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787388059.830498:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:0.0:1787388059.884615:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945692416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388059.884686:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388059.884822:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945692416 00000100:00100000:2.0:1787388059.884830:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945692416 00000100:00100000:2.0:1787388059.884896:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787388059.884906:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945692416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388059.884940:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388059.884990:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945692416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388059.884997:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1787388059.885042:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58ca80 x1874211945692416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388059.885059:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945692416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388059.885495:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945692544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388059.885531:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388059.885757:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945692544 00000100:00100000:0.0:1787388059.885763:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945692544 00000100:00100000:0.0:1787388059.885810:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787388059.885818:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945692544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388059.885830:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388059.885874:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945692544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388059.885880:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1787388059.886030:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43934a80 x1874211945692544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388059.886044:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945692544:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787388059.886696:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388059.916649:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388059.916843:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925680256 00000100:00100000:1.0:1787388059.916853:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925680256 00000100:00100000:1.0:1787388059.916912:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:1.0:1787388059.916923:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+13:10528:x1874211925680256:12345-192.168.203.15@tcp:101:rm.0 00010000:00010000:1.0:1787388059.916961:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388059.916981:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d77 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.917055:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474687 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.917069:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.917079:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388059.917121:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388059.917125:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388059.917156:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.917192:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d77 expref: 15 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.917210:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d77 expref: 14 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388059.917219:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388059.917222:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388059.917226:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076400, rc 0) 00000100:00100000:1.0:1787388059.917299:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+14:10528:x1874211925680256:12345-192.168.203.15@tcp:101:rm.0 Request processed in 377us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388059.917306:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:2.0:1787388059.934109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388059.934190:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925680512 00000100:00100000:3.0:1787388059.934200:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925680512 00000100:00100000:3.0:1787388059.934274:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:3.0:1787388059.934285:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+14:10528:x1874211925680512:12345-192.168.203.15@tcp:101:rm.0 00010000:00010000:3.0:1787388059.934305:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388059.934327:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a447468e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d7e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388059.934469:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787388059.934607:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a447468e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d7e expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.934621:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595100) 00010000:00010000:3.0:1787388059.934624:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388059.934629:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a447468e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d7e expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.934644:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7000, rc 0) 00000100:00100000:3.0:1787388059.934711:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+15:10528:x1874211925680512:12345-192.168.203.15@tcp:101:rm.0 Request processed in 428us (610us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1787388059.934726:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:3.0:1787388059.955548:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388059.955659:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925680640 00000100:00100000:2.0:1787388059.955669:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925680640 00000100:00100000:2.0:1787388059.955728:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:2.0:1787388059.955739:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:10528:x1874211925680640:12345-192.168.203.15@tcp:37:rm.0 00000100:00100000:2.0:1787388059.968290:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:10528:x1874211925680640:12345-192.168.203.15@tcp:37:rm.0 Request processed in 12542us (12740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388059.968305:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:3.0:1787388059.979117:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388059.979260:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925680896 00000100:00100000:0.0:1787388059.979270:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925680896 00000100:00100000:0.0:1787388059.979325:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:0.0:1787388059.979335:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dcce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+15:10528:x1874211925680896:12345-192.168.203.15@tcp:35:rm.0 00000100:00100000:0.0:1787388059.979600:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dcce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+16:10528:x1874211925680896:12345-192.168.203.15@tcp:35:rm.0 Request processed in 264us (490us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787388059.979608:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:2.0:1787388059.983002:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388059.983129:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925681152 00000100:00100000:3.0:1787388059.983138:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925681152 00000100:00100000:3.0:1787388059.983233:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:3.0:1787388059.983251:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+16:10528:x1874211925681152:12345-192.168.203.15@tcp:101:rm.0 00010000:00010000:3.0:1787388059.983274:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388059.983292:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a447469c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d85 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.983436:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a44746a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.983452:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a44746a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.983462:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a44746a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388059.983473:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787388059.983614:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a447469c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d85 expref: 19 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.983632:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a44746a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d85 expref: 18 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388059.983639:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:3.0:1787388059.983649:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787388059.983653:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7400, rc 0) 00000100:00100000:3.0:1787388059.983705:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+18:10528:x1874211925681152:12345-192.168.203.15@tcp:101:rm.0 Request processed in 455us (710us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787388059.983712:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:2.0:1787388059.993100:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388059.993183:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925681280 00000100:00100000:3.0:1787388059.993194:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925681280 00000100:00100000:3.0:1787388059.993259:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:3.0:1787388059.993270:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:10528:x1874211925681280:12345-192.168.203.15@tcp:41:rm.0 00000004:00000024:3.0:1787388059.993326:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1787388059.993440:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:10528:x1874211925681280:12345-192.168.203.15@tcp:41:rm.0 Request processed in 172us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388059.993449:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:0.0:1787388060.000825:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388060.000978:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925681408 00000100:00100000:3.0:1787388060.000989:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925681408 00000100:00100000:3.0:1787388060.001053:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:3.0:1787388060.001063:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+18:10528:x1874211925681408:12345-192.168.203.15@tcp:101:rm.0 00010000:00010000:3.0:1787388060.001084:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388060.001103:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a44746b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d8c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001167:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a44746b8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001182:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a44746b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001193:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a44746b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001219:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a44746bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001226:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a44746bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001243:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a44746bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001327:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44746c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001335:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44746c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001342:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44746c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388060.001415:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787388060.001419:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388060.001437:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44746c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001449:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44746c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001458:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a44746b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001465:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a44746b8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001480:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a44746b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001486:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388060.001489:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a44746b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001496:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a44746b8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001508:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:3.0:1787388060.001512:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388060.001516:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a44746b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001523:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a44746b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001535:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a44746bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001542:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a44746bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001547:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a44746bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001552:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388060.001555:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a44746bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001571:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a44746bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001580:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xfcf4bd8d (ffff996a43284500) 00010000:00010000:3.0:1787388060.001582:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388060.001585:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a44746bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001591:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a44746bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001618:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a44746b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d8c expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001630:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44746c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d8c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.001635:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff996b58595c00) 00010000:00010000:3.0:1787388060.001637:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388060.001639:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6800, rc 0) 00000100:00100000:3.0:1787388060.001699:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+19:10528:x1874211925681408:12345-192.168.203.15@tcp:101:rm.0 Request processed in 636us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388060.001706:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00080000:2.0:1787388060.001840:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388060.006007:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388060.006267:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925681664 00000100:00100000:3.0:1787388060.006277:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925681664 00000100:00100000:3.0:1787388060.006339:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:3.0:1787388060.006379:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+19:10528:x1874211925681664:12345-192.168.203.15@tcp:36:rm.0 00010000:00010000:3.0:1787388060.006578:0:10197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787388060.006617:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44746c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d8c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006641:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4474672 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d70 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006653:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff996b58595c00) 00010000:00010000:3.0:1787388060.006662:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4474687 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d77 expref: 17 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006672:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:3.0:1787388060.006675:0:10197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388060.006695:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44746cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006707:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44746cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006716:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44746cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006727:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006735:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006741:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006956:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a44746db lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006969:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a44746db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.006976:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a44746db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787388060.007322:0:10197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787388060.007333:0:10197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381529985233ns, next at 382529983242ns, rc = 0 00010000:00010000:3.0:1787388060.007639:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007649:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007657:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007664:0:10197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007671:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007676:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007737:0:10197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388060.007756:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a44746db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007763:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a44746db lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007788:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a44746db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007794:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7e00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388060.007798:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a44746db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007813:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a44746db lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007823:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff996b58595c00) 00010000:00010000:3.0:1787388060.007826:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787388060.007830:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a44746db lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007836:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a44746db lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007854:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44746cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007861:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44746cd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007866:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44746cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007871:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388060.007874:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44746cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007892:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44746cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007901:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:3.0:1787388060.007903:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388060.007906:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44746cd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007912:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44746cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388060.007923:0:10197:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021ef922d reply state 0000000023d6fb0b transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007933:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388060.007940:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xfcf4bd8d (ffff996a43284500) 00010000:00010000:3.0:1787388060.007942:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388060.007944:0:10197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388060.008032:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+18:10528:x1874211925681664:12345-192.168.203.15@tcp:36:rm.0 Request processed in 1683us (2032us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787388060.008039:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:0.0:1787388060.020849:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388060.020993:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925681920 00000100:00100000:3.0:1787388060.021004:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925681920 00000100:00100000:3.0:1787388060.021069:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:3.0:1787388060.021078:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+18:10528:x1874211925681920:12345-192.168.203.15@tcp:35:rm.0 00000100:00100000:3.0:1787388060.021310:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+19:10528:x1874211925681920:12345-192.168.203.15@tcp:35:rm.0 Request processed in 233us (470us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787388060.021335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:3.0:1787388060.024947:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388060.025088:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925682176 00000100:00100000:1.0:1787388060.025099:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925682176 00000100:00100000:1.0:1787388060.025153:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:1.0:1787388060.025163:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+19:10528:x1874211925682176:12345-192.168.203.15@tcp:36:rm.0 00010000:00010000:1.0:1787388060.025218:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787388060.025256:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a44746a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d85 expref: 19 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025279:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4474641 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d62 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025290:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388060.025305:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09200/0x26817551a4474602 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d54 expref: 17 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025314:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595100) 00010000:00010000:1.0:1787388060.025320:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388060.025342:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a44746e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025377:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a44746e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025386:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a44746e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025398:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025414:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025432:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025510:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44746f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025518:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44746f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025525:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44746f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388060.025747:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787388060.025764:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44746f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025771:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44746f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025778:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44746f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025785:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388060.025789:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44746f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025796:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44746f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025814:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff996b728f5200) 00010000:00010000:1.0:1787388060.025817:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787388060.025828:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44746f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025835:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a44746f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025854:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a44746e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025860:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a44746e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025866:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a44746e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025871:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388060.025874:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a44746e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025880:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a44746e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025887:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b728f5300) 00010000:00010000:1.0:1787388060.025890:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388060.025893:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a44746e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025898:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a44746e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388060.025909:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042d1b1bf reply state 00000000413bc966 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025932:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388060.025938:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996b728f5a00) 00010000:00010000:1.0:1787388060.025941:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388060.025943:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388060.026003:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+18:10528:x1874211925682176:12345-192.168.203.15@tcp:36:rm.0 Request processed in 842us (1065us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787388060.026011:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00010000:00010000:2.0:1787388060.028341:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388060.028365:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.028376:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388060.028381:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.028419:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.028436:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff996b58595c00) 00010000:00010000:2.0:1787388060.028439:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787388060.028444:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.028450:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a44746e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388060.028469:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388060.028471:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388060.028472:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388060.269078:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388061.296207:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388061.937903:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388061.937936:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945692672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388061.938028:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388061.938292:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945692672 00000100:00100000:1.0:1787388061.938305:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945692672 00000100:00100000:1.0:1787388061.938402:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787388061.938413:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945692672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388061.942311:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388061.942452:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945692672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4036us (4419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388061.942462:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787388061.943523:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945692672:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388062.317099:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388062.919041:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388062.919091:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388062.919124:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388062.919188:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388062.919237:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388062.919270:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388062.919306:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925682688 00000100:00100000:1.0:1787388062.919317:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925682688 00000100:00100000:1.0:1787388062.919445:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 84 00000100:00100000:1.0:1787388062.919466:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925682688:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388062.919560:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925682688:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 97us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.919569:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 84 00000100:00100000:1.0:1787388062.919596:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925682560 00000100:00100000:1.0:1787388062.919599:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925682560 00000100:00100000:1.0:1787388062.919629:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925682816 00000100:00100000:1.0:1787388062.919632:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925682816 00000100:00100000:1.0:1787388062.919647:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925682432 00000100:00100000:1.0:1787388062.919649:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925682432 00000100:00100000:1.0:1787388062.919660:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925682944 00000100:00100000:1.0:1787388062.919662:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925682944 00000100:00100000:1.0:1787388062.919677:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 231 00000100:00100000:1.0:1787388062.919684:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925682560:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388062.919715:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925682560:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.919721:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 231 00000100:00100000:1.0:1787388062.919734:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 232 00000100:00100000:1.0:1787388062.919739:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925682816:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388062.919763:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925682816:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.919770:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 232 00000100:00100000:1.0:1787388062.919781:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 233 00000100:00100000:1.0:1787388062.919789:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+18:2402:x1874211925682432:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388062.919817:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+18:2402:x1874211925682432:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.919830:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 233 00000100:00100000:1.0:1787388062.919843:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 234 00000100:00100000:1.0:1787388062.919850:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925682944:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388062.919886:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925682944:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 37us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.919892:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 234 00000100:00080000:1.0:1787388062.919910:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388062.919915:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388062.919918:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388062.920399:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925682304 00000100:00100000:2.0:1787388062.920406:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925682304 00000100:00100000:2.0:1787388062.920441:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 343 00000100:00100000:2.0:1787388062.920449:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925682304:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388062.920489:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925682304:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 41us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388062.920496:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 343 00000100:00100000:0.0:1787388062.957133:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388062.957165:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945692800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388062.957731:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388062.957867:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945692928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388062.957928:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388062.958329:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945693184:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.958396:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388062.958417:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945693696:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.958439:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388062.958454:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945694208:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.958474:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388062.958494:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787388062.958499:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945693056:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.958531:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388062.958553:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945693568:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.958578:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388062.958596:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945694080:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.958619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388062.958652:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945693056 00000100:00100000:3.0:1787388062.958661:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945693056 00000100:00100000:3.0:1787388062.958716:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787388062.958725:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945693056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.958786:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945693056:12345-0@lo:400:kworker.0 Request processed in 61us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.958794:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787388062.958850:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945693568 00000100:00100000:3.0:1787388062.958855:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945693568 00000100:00100000:3.0:1787388062.958887:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787388062.958894:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945693568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.958930:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945693568:12345-0@lo:400:kworker.0 Request processed in 37us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.958937:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787388062.958958:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945694080 00000100:00100000:3.0:1787388062.958961:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945694080 00000100:00100000:3.0:1787388062.959014:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787388062.959021:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945694080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.959052:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945694080:12345-0@lo:400:kworker.0 Request processed in 32us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.959058:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787388062.959080:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945693184 00000100:00100000:3.0:1787388062.959084:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945693184 00000100:00100000:3.0:1787388062.959108:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945693696 00000100:00100000:3.0:1787388062.959111:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945693696 00000100:00100000:3.0:1787388062.959130:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945694208 00000100:00100000:3.0:1787388062.959132:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945694208 00000100:00100000:3.0:1787388062.959146:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787388062.959151:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945693184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.959182:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945693184:12345-0@lo:400:kworker.0 Request processed in 30us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.959188:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787388062.959198:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787388062.959204:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945693696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.959240:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945693696:12345-0@lo:400:kworker.0 Request processed in 36us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.959254:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787388062.959266:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787388062.959272:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945694208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.959301:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945694208:12345-0@lo:400:kworker.0 Request processed in 30us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.959307:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787388062.959378:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945693056:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.959392:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945693568:0@lo:400:kworker.0 00010000:00080000:3.0:1787388062.959405:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43922d80 x1874211945694080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388062.959416:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945694080:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.959427:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945693184:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.959437:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945693696:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.959447:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945694208:0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.959712:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945693312:0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.959754:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388062.959786:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945693824:0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.959806:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388062.959824:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945694336:0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.959845:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388062.959864:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787388062.959870:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945693440:0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.959891:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388062.959902:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945693952:0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.959923:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388062.959941:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945694464:0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.959961:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388062.960004:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945693952 00000100:00100000:1.0:1787388062.960009:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945693952 00000100:00100000:1.0:1787388062.960051:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945694464 00000100:00100000:1.0:1787388062.960054:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945694464 00000100:00100000:1.0:1787388062.960073:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787388062.960080:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945693952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.960122:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945693952:12345-0@lo:400:kworker.0 Request processed in 42us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.960128:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787388062.960143:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787388062.960151:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945694464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.960179:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945694464:12345-0@lo:400:kworker.0 Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.960197:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787388062.960231:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945693824 00000100:00100000:1.0:1787388062.960235:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945693824 00000100:00100000:1.0:1787388062.960255:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945694336 00000100:00100000:1.0:1787388062.960258:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945694336 00000100:00100000:1.0:1787388062.960270:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945693440 00000100:00100000:1.0:1787388062.960272:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945693440 00000100:00100000:1.0:1787388062.960284:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787388062.960290:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945693824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.960320:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945693824:12345-0@lo:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.960325:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787388062.960336:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787388062.960342:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945694336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.960503:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945694336:12345-0@lo:400:kworker.0 Request processed in 161us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.960519:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787388062.960533:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787388062.960540:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945693440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388062.960569:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945693440:12345-0@lo:400:kworker.0 Request processed in 30us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.960574:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:1.0:1787388062.960597:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388062.960603:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388062.960605:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388062.960607:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388062.960644:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945693440:0@lo:400:kworker.0 00010000:00080000:1.0:1787388062.960657:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43922680 x1874211945693952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388062.960666:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945693952:0@lo:400:kworker.0 00010000:00080000:1.0:1787388062.960675:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43923800 x1874211945694464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388062.960683:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945694464:0@lo:400:kworker.0 00010000:00080000:1.0:1787388062.960691:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43920a80 x1874211945693824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388062.960698:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945693824:0@lo:400:kworker.0 00010000:00080000:1.0:1787388062.960707:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43923b80 x1874211945694336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388062.960714:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945694336:0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.962342:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945693312 00000100:00100000:3.0:1787388062.962571:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945693312 00000100:00100000:3.0:1787388062.962645:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787388062.962656:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945693312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388062.962765:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945693312:12345-0@lo:400:kworker.0 Request processed in 111us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388062.962773:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787388062.962827:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945693312:0@lo:400:kworker.0 00000100:00100000:2.0:1787388062.972728:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945692800 00000100:00100000:2.0:1787388062.972750:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945692800 00000100:00100000:1.0:1787388062.972964:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945692928 00000100:00100000:1.0:1787388062.972969:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945692928 00000100:00100000:1.0:1787388062.973008:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787388062.973020:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945692800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388062.973069:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388062.973160:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945692800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (15430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.973167:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787388062.973210:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787388062.973225:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945692928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388062.973242:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388062.973266:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945692928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (15338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388062.973273:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1787388062.973507:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787388062.973548:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a15c00 x1874211945692928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388062.973578:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945692928:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787388062.973593:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a14000 x1874211945692800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388062.973612:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945692800:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787388063.342177:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388063.980680:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388063.980710:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945694592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388063.980802:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388063.980884:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945694592 00000100:00100000:2.0:1787388063.980894:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945694592 00000100:00100000:2.0:1787388063.980966:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787388063.980976:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945694592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388063.981030:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388063.981102:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945694592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388063.981111:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787388063.984607:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945694592:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388064.368796:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388065.006573:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388065.006603:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945694720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388065.006674:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388065.006723:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945694720 00000100:00100000:1.0:1787388065.006736:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945694720 00000100:00100000:1.0:1787388065.006816:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787388065.006830:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945694720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388065.006873:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787388065.006917:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388065.006955:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945694720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388065.006964:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1787388065.007137:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a14e00 x1874211945694720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388065.007162:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945694720:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1787388065.007416:0:8488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386530067122ns, next at 387530063483ns, rc = 0 00000100:00100000:0.0:1787388065.007456:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388065.007471:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945694848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388065.007509:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388065.013184:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945694848 00000100:00100000:2.0:1787388065.013198:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945694848 00000100:00100000:3.0:1787388065.014564:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787388065.014579:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945694848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388065.014612:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388065.014828:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945694848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 252us (7315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388065.014837:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1787388065.014896:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a14e00 x1874211945694848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388065.014919:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945694848:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1787388065.016957:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787388065.016998:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1787388065.017217:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1787388065.017254:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017269:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017278:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017285:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388065.017445:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017456:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017492:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xfcf4bd8d (ffff996a43284500) 00010000:00010000:3.0:1787388065.017496:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388065.017502:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017510:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474656 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017532:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017539:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017544:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017549:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388065.017552:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017557:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017564:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff996b58595c00) 00010000:00010000:3.0:1787388065.017566:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388065.017569:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017574:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a447466b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017715:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017722:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017727:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017732:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388065.017735:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017741:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017749:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xfcf4bd8d (ffff996a43284500) 00010000:00010000:3.0:1787388065.017751:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388065.017754:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017760:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44746d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xfcf4bd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017774:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017781:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017787:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017798:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077c00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388065.017801:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017807:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017816:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996b728f5a00) 00010000:00010000:3.0:1787388065.017818:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388065.017821:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388065.017827:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a44746f0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388065.019183:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388065.019213:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945694976:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787388065.019279:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388065.019335:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945694976 00000100:00100000:2.0:1787388065.019343:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945694976 00000100:00100000:2.0:1787388065.019406:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787388065.019421:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945694976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787388065.019446:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1787388065.019481:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a89609c, atime: 0x6a89609c, ctime: 0x6a89609c, blocks: 0x0 00010000:00010000:2.0:1787388065.019489:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6bf628c/0x26817551a44746fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388065.019506:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1787388065.019510:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388065.019516:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6bf628c/0x26817551a44746fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388065.019532:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6bf628c/0x26817551a44746fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388065.019551:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6bf628c/0x26817551a44746fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388065.019560:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6bf628c/0x26817551a44746fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388065.019578:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787388065.019710:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874211945694976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 290us (429us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787388065.019717:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787388065.019739:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388065.019745:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6bf628c/0x26817551a44746fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388065.019752:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388065.019757:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6bf628c/0x26817551a44746fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388065.019767:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6bf628c/0x26817551a44746fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388065.019784:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6bf628c/0x26817551a44746fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388065.019791:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6bf628c/0x26817551a44746fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388065.019826:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388065.019828:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388065.019830:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787388065.019858:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996a43a16300/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787388065.019863:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945694976:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1787388065.021240:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787388065.380935:0:13688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1787388065.399929:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388066.418325:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787388066.466958:0:13736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc6dde8540 00000020:00000080:2.0:1787388066.466973:0:13736:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787388066.466978:0:13736:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787388066.466986:0:13736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6ddea7d0 20000000:00000080:2.0:1787388066.466993:0:13736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996a432eb400 uarg=0000000000000000 20000000:01000000:2.0:1787388066.467039:0:13736:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787388066.467045:0:13736:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787388066.467050:0:13736:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787388066.468103:0:13737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787388066.468211:0:13736:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787388066.475249:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787388066.475301:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787388066.475324:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787388066.475342:0:13736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787388066.475605:0:13736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.475625:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b70077000/0x26817551a447458b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d3f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.475634:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b70077200/0x26817551a4474592 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d46 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.475643:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b74e09400/0x26817551a44745a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474599 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.475665:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b74e08c00/0x26817551a44745ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44745a7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.475671:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a432f7c00/0x26817551a44745bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44745b5 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.475677:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b74e09000/0x26817551a44745ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44745c3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.475685:0:13736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.475724:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b74e09000/0x26817551a44745ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44745c3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.475738:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b74e09000/0x26817551a44745ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44745c3 expref: 23 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388066.475755:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695104:0@lo:104: 00000100:00100000:2.0:1787388066.475820:0:13736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388066.475925:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a432f7c00/0x26817551a44745bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44745b5 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.475934:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a432f7c00/0x26817551a44745bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44745b5 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388066.475943:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695232:0@lo:104: 00010000:00010000:2.0:1787388066.475986:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b74e08c00/0x26817551a44745ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44745a7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.476004:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b74e08c00/0x26817551a44745ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44745a7 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388066.476012:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695360:0@lo:104: 00010000:00010000:2.0:1787388066.476040:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b74e09400/0x26817551a44745a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4474599 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.476047:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b74e09400/0x26817551a44745a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4474599 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388066.476056:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695488:0@lo:104: 00010000:00010000:2.0:1787388066.476080:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b70077200/0x26817551a4474592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d46 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.476089:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b70077200/0x26817551a4474592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d46 expref: 12 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388066.476098:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695616:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388066.476158:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b70077000/0x26817551a447458b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d3f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.476166:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b70077000/0x26817551a447458b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d3f expref: 12 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388066.476174:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695744:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388066.476209:0:13736:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b42e08cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388066.476847:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787388066.476876:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388066.476904:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388066.476926:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388066.476935:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945695104 00000100:00100000:2.0:1787388066.476941:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945695104 00000100:00100000:2.0:1787388066.476982:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945695232 00000100:00100000:2.0:1787388066.476985:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945695232 00000100:00100000:2.0:1787388066.476997:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945695360 00000100:00100000:2.0:1787388066.477000:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945695360 00000100:00100000:2.0:1787388066.477009:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945695488 00000100:00100000:2.0:1787388066.477011:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945695488 00000100:00100000:2.0:1787388066.477023:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388066.477030:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4321bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+6:13736:x1874211945695104:12345-0@lo:104: 00010000:00010000:2.0:1787388066.477042:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.477093:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388066.477099:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4321bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+6:13736:x1874211945695104:12345-0@lo:104: Request processed in 70us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388066.477105:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388066.477144:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787388066.477149:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+5:13736:x1874211945695232:12345-0@lo:104: 00010000:00010000:2.0:1787388066.477156:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.477181:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787388066.477185:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+5:13736:x1874211945695232:12345-0@lo:104: Request processed in 37us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388066.477200:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787388066.477212:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787388066.477224:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:13736:x1874211945695360:12345-0@lo:104: 00010000:00010000:2.0:1787388066.477231:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.477254:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787388066.477257:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+4:13736:x1874211945695360:12345-0@lo:104: Request processed in 35us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388066.477262:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787388066.477271:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787388066.477276:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:13736:x1874211945695488:12345-0@lo:104: 00010000:00010000:2.0:1787388066.477281:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.477298:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787388066.477301:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:530741c0-7948-4b28-86b1-ece4c1322eb9+3:13736:x1874211945695488:12345-0@lo:104: Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388066.477306:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787388066.477341:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695104:0@lo:104: 00000100:00100000:2.0:1787388066.477490:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695232:0@lo:104: 00000100:00100000:2.0:1787388066.477497:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695360:0@lo:104: 00000100:00100000:2.0:1787388066.477503:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695488:0@lo:104: 00010000:00010000:0.0:1787388066.478045:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787388066.478053:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478062:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787388066.478066:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478075:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388066.478082:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388066.478088:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787388066.478136:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478142:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787388066.478173:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478179:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a432f6400/0x26817551a44745c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478200:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787388066.478203:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478209:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787388066.478221:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478228:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388066.478234:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388066.478239:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787388066.478255:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478260:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787388066.478267:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478272:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a44745b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478280:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787388066.478283:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478289:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787388066.478291:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478298:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388066.478313:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388066.478318:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787388066.478333:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.478337:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787388066.478459:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945695872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388066.478506:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388066.478543:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388066.478549:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945696000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388066.478570:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388066.478596:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945695872 00000100:00100000:3.0:1787388066.478601:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945695872 00010000:00010000:3.0:1787388066.478622:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b74e09000/0x26817551a44745ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44745c3 expref: 24 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388066.478640:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945696000 00000100:00100000:3.0:1787388066.478643:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945696000 00010000:00010000:3.0:1787388066.478661:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a432f7c00/0x26817551a44745bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44745b5 expref: 25 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388066.478681:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787388066.478688:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43921c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+25:3649:x1874211945695872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388066.478699:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388066.478704:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b74e09000/0x26817551a44745ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44745c3 expref: 25 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388066.478715:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b74e09000/0x26817551a44745ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44745c3 expref: 25 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388066.478731:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09000/0x26817551a44745ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44745c3 expref: 25 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388066.478743:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388066.478773:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43921c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945695872:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388066.478780:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787388066.478796:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787388066.478801:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3649:x1874211945696000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388066.478809:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388066.478813:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a432f7c00/0x26817551a44745bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44745b5 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388066.478838:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a432f7c00/0x26817551a44745bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44745b5 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388066.478849:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a432f7c00/0x26817551a44745bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44745b5 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388066.478868:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388066.478891:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:3649:x1874211945696000:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388066.478897:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787388066.478934:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945696000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388066.478942:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945695872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388066.479018:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1787388066.479038:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.479045:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a431e4200/0x26817551a44745a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.479054:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388066.479057:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.479063:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787388066.479066:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.479073:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388066.479079:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388066.479085:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787388066.479109:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.479115:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787388066.479740:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945696256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388066.479777:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388066.479812:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945696128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388066.479831:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388066.479858:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945696256 00000100:00100000:3.0:1787388066.479862:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945696256 00010000:00010000:3.0:1787388066.479880:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b74e09400/0x26817551a44745a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474599 expref: 22 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388066.479898:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945696128 00000100:00100000:3.0:1787388066.479900:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945696128 00010000:00010000:3.0:1787388066.479910:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b74e08c00/0x26817551a44745ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44745a7 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388066.479924:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787388066.479930:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3652:x1874211945696256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388066.479937:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388066.479941:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff996b74e09400/0x26817551a44745a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4474599 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388066.479962:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b74e09400/0x26817551a44745a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4474599 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388066.480040:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787388066.480050:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3652:x1874211945696128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388066.480057:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388066.480063:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff996b74e08c00/0x26817551a44745ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44745a7 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.480224:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.480233:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a431e5200/0x26817551a4474599 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44745a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.480248:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388066.480250:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388066.480252:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388066.480259:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388066.480321:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b74e08c00/0x26817551a44745ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44745a7 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.480336:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e08c00/0x26817551a44745ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44745a7 expref: 23 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.480541:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388066.480609:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:3652:x1874211945696128:12345-0@lo:103:ldlm_bl.0 Request processed in 561us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388066.480617:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787388066.480660:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695616:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388066.480670:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874211945695744:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388066.480701:0:13736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388066.480771:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09400/0x26817551a44745a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4474599 expref: 21 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388066.480781:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388066.480804:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:3652:x1874211945696256:12345-0@lo:103:ldlm_bl.0 Request processed in 875us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388066.480810:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787388066.480894:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945696128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388066.480919:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945696256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388066.486319:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388066.486493:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925683072 00000100:00100000:0.0:1787388066.486504:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925683072 00010000:00010000:0.0:1787388066.486545:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b70077200/0x26817551a4474592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d46 expref: 13 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388066.486583:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:0.0:1787388066.486593:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43921180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925683072:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388066.486607:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388066.486613:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff996b70077200/0x26817551a4474592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d46 expref: 13 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.486626:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b70077200/0x26817551a4474592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d46 expref: 13 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.486645:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70077200/0x26817551a4474592 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d46 expref: 13 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.486678:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388066.486737:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43921180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c26a556f-3215-464e-beb8-43d9848a19a5+12:2401:x1874211925683072:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 145us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388066.486745:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:1.0:1787388066.488674:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388066.488756:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925683200 00000100:00100000:2.0:1787388066.488765:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925683200 00010000:00010000:2.0:1787388066.488806:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b70077000/0x26817551a447458b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d3f expref: 12 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388066.488845:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:2.0:1787388066.488854:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+12:2401:x1874211925683200:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388066.488868:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388066.488873:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff996b70077000/0x26817551a447458b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d3f expref: 12 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.488885:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b70077000/0x26817551a447458b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d3f expref: 12 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.488915:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70077000/0x26817551a447458b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d3f expref: 12 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.488929:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.488937:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.488953:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.488959:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.488966:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.488973:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.488979:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4000 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388066.488983:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.488991:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.489090:0:13736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388066.489098:0:13736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.489504:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.489524:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e4000/0x26817551a4474705 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388066.489540:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388066.489586:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+11:2401:x1874211925683200:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 732us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388066.489594:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:2.0:1787388067.060557:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388067.060591:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945696384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388067.060657:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388067.060868:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945696384 00000100:00100000:1.0:1787388067.060877:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945696384 00000100:00100000:1.0:1787388067.060929:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787388067.060938:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945696384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388067.060987:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388067.062082:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945696384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1142us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388067.062092:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787388067.062316:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945696384:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388067.436784:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787388067.531654:0:13785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd1919d000 00000020:00000080:3.0:1787388067.531671:0:13785:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787388067.531677:0:13785:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787388067.531685:0:13785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1919f290 20000000:00000080:3.0:1787388067.531692:0:13785:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996b412aac00 uarg=0000000000000000 20000000:01000000:3.0:1787388067.531735:0:13785:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1787388067.531741:0:13785:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1787388067.531746:0:13785:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1787388067.532614:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1787388067.533228:0:13785:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1787388067.533816:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1787388067.533851:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1787388067.533869:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1787388067.533881:0:13785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787388067.534556:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388067.535072:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388067.535107:0:13785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388067.535114:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388067.535121:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388067.535129:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388067.535136:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388067.535141:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388067.535149:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388067.535162:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388067.535169:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388067.535175:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a432f7800/0x26817551a447470c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388067.885342:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787388067.885373:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b7f53f000 from 7 10000000:01000000:2.0:1787388067.885377:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388067.885825:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388067.885840:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388067.885851:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388067.885879:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945696512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388067.885951:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388067.886078:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7bde96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388067.890918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945696512 00000100:00100000:1.0:1787388067.890934:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945696512 00000100:00100000:1.0:1787388067.891064:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787388067.891075:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+20:6518:x1874211945696512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388067.891091:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388067.891111:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70077000/0x26817551a447471a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474713 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388067.891149:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077000/0x26817551a447471a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474713 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388067.891166:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70077000/0x26817551a447471a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474713 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388067.891175:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077000, rc 0) 00000100:00100000:1.0:1787388067.891554:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945696512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (5311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388067.891576:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787388067.891679:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945696512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388067.891705:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388067.891715:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388067.891794:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945696640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388067.891832:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388067.892081:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7bde96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388067.892170:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945696640 00000100:00100000:3.0:1787388067.892176:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945696640 00000100:00100000:3.0:1787388067.892217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787388067.892225:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945696640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388067.894089:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945696640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1857us (2248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388067.894459:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787388067.896753:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945696640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388067.896831:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945696768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388067.896976:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388067.897018:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7bde96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388067.897040:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945696768 00000100:00100000:1.0:1787388067.897048:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945696768 00000100:00100000:1.0:1787388067.897109:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787388067.897120:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945696768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388067.897267:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945696768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388067.897275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787388067.897506:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945696768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.898257:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13799:1874211945696896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388067.898307:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388067.898958:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787388067.900512:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945696896 00000100:00100000:3.0:1787388067.900524:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945696896 00000100:00100000:3.0:1787388067.900589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787388067.900599:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:13799:x1874211945696896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388067.900761:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+21:13799:x1874211945696896:12345-0@lo:502:llog_process_th.0 Request processed in 163us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388067.900769:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787388067.901762:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13799:1874211945696896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787388067.901807:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388067.901818:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388067.901820:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787388067.901827:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b7f53f000 00000020:00000080:0.0:1787388067.901830:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388067.902576:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388067.902584:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388067.902585:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787388067.902588:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388067.902591:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388067.902592:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787388067.902595:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b7f53f000 00000020:00000080:0.0:1787388067.902597:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787388067.912010:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13799:1874211945697024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388067.912094:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388067.912987:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787388067.914071:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945697024 00000100:00100000:2.0:1787388067.914082:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945697024 00000100:00100000:2.0:1787388067.914516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787388067.914528:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:13799:x1874211945697024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388067.916553:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:13799:x1874211945697024:12345-0@lo:502:llog_process_th.0 Request processed in 2018us (4449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388067.916568:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787388067.921230:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13799:1874211945697024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787388067.921521:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388067.921533:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388067.921535:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787388067.921540:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787388067.921748:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787388067.921778:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787388067.921789:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388067.921801:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388067.921812:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787388067.921814:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b74ea1800 from 7 10000000:01000000:1.0:1787388067.921817:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787388067.921853:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388067.921861:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388067.921871:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388067.921893:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945697152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787388067.921965:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388067.922007:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388067.922091:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945697152 00000100:00100000:2.0:1787388067.922099:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945697152 00000100:00100000:2.0:1787388067.922159:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787388067.922168:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:6518:x1874211945697152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388067.922200:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388067.922212:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e4a00/0x26817551a4474728 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4474721 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388067.922235:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e4a00/0x26817551a4474728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4474721 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388067.922245:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e4a00/0x26817551a4474728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4474721 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388067.922254:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4a00, rc 0) 00000100:00100000:2.0:1787388067.922556:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945697152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 388us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388067.922562:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000040:00080000:3.0:1787388067.923101:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787388067.926141:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945697152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388067.926170:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388067.927165:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388067.927262:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945697280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388067.927897:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388067.927940:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388067.928956:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945697280 00000100:00100000:0.0:1787388067.928966:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945697280 00000100:00100000:0.0:1787388067.929014:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787388067.929024:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945697280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.931506:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945697280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2476us (3601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.931519:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787388067.931829:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945697280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388067.931884:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43920e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945697408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388067.931939:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388067.931974:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4607e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388067.932111:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945697408 00000100:00100000:1.0:1787388067.932117:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945697408 00000100:00100000:1.0:1787388067.932169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787388067.932177:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945697408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388067.932987:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945697408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 807us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388067.932995:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787388067.933146:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43920e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945697408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388067.933863:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13803:1874211945697536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388067.933914:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388067.933945:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388067.933994:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945697536 00000100:00100000:0.0:1787388067.934000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945697536 00000100:00100000:0.0:1787388067.934037:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787388067.934045:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:13803:x1874211945697536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388067.936506:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:13803:x1874211945697536:12345-0@lo:502:llog_process_th.0 Request processed in 2453us (2582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.936519:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787388067.937687:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13803:1874211945697536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787388067.937730:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388067.937741:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388067.937744:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787388067.937759:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b74ea1800 00000020:00000080:1.0:1787388067.937762:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787388067.937823:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388067.938050:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388067.938052:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787388067.938057:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388067.938060:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388067.938062:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787388067.938065:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b74ea1800 00000020:00000080:1.0:1787388067.938068:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787388067.938331:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13803:1874211945697664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388067.942262:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388067.942329:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388067.944063:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945697664 00000100:00100000:0.0:1787388067.944076:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945697664 00000100:00100000:0.0:1787388067.944127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787388067.944147:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:13803:x1874211945697664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388067.944328:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+22:13803:x1874211945697664:12345-0@lo:502:llog_process_th.0 Request processed in 192us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.944374:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787388067.944623:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13803:1874211945697664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787388067.944660:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388067.944669:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388067.944671:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787388067.944676:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787388067.944826:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787388067.944849:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787388067.944858:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.944870:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388067.944880:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787388067.944882:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b73aa7800 from 7 10000000:01000000:0.0:1787388067.944886:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787388067.945332:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.945342:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.945584:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388067.945608:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945697792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.945661:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388067.945702:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388067.946140:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945697792 00000100:00100000:2.0:1787388067.946147:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945697792 00000100:00100000:2.0:1787388067.946204:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787388067.946212:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:6518:x1874211945697792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388067.946223:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388067.946236:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a431e5200/0x26817551a4474736 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447472f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388067.946259:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a431e5200/0x26817551a4474736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447472f expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388067.946497:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a431e5200/0x26817551a4474736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447472f expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388067.946505:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e5200, rc 0) 00000100:00100000:2.0:1787388067.946551:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945697792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 340us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388067.946557:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787388067.947599:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945697792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388067.947619:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.947629:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388067.947713:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945697920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.947753:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388067.947781:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388067.947798:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945697920 00000100:00100000:0.0:1787388067.947803:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945697920 00000100:00100000:0.0:1787388067.947829:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787388067.947837:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945697920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.947961:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945697920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.947968:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787388067.948000:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945697920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.948026:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945698048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.948064:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388067.948078:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388067.948089:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945698048 00000100:00100000:0.0:1787388067.948092:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945698048 00000100:00100000:0.0:1787388067.948109:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787388067.948114:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945698048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.958052:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945698048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 9927us (9977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.958067:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787388067.958170:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945698048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787388067.959259:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787388067.960695:0:13806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43920e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13806:1874211945698176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388067.960770:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388067.960813:0:13806:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4607e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388067.960857:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945698176 00000100:00100000:0.0:1787388067.960865:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945698176 00000100:00100000:0.0:1787388067.961232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787388067.961243:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:13806:x1874211945698176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388067.961651:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:13806:x1874211945698176:12345-0@lo:502:llog_process_th.0 Request processed in 409us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.961660:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787388067.962225:0:13806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43920e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13806:1874211945698176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388067.962261:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388067.962753:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388067.962763:0:13806:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787388067.962772:0:13806:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b73aa7800 00000020:00000080:3.0:1787388067.962775:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787388067.962866:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388067.962870:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388067.962872:0:13806:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787388067.962874:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388067.962876:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388067.962877:0:13806:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787388067.962880:0:13806:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b73aa7800 00000020:00000080:3.0:1787388067.962882:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787388067.963954:0:13806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43920e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13806:1874211945698304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388067.964022:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388067.964055:0:13806:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b44e06240 going to sleep for 11 seconds 00000100:00100000:0.0:1787388067.964235:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945698304 00000100:00100000:0.0:1787388067.964241:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945698304 00000100:00100000:0.0:1787388067.964299:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787388067.964308:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:13806:x1874211945698304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388067.964739:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+23:13806:x1874211945698304:12345-0@lo:502:llog_process_th.0 Request processed in 431us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.964747:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787388067.964842:0:13806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43920e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13806:1874211945698304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388067.964869:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388067.964875:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388067.964877:0:13806:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787388067.964881:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787388067.965142:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787388067.965166:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787388067.965176:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.965197:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388067.965208:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787388067.965211:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b46a34000 from 7 10000000:01000000:0.0:1787388067.965214:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787388067.965242:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.965250:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.965278:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388067.965293:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945698432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.965326:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388067.965621:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388067.965636:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945698432 00000100:00100000:0.0:1787388067.965641:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945698432 00000100:00100000:0.0:1787388067.965668:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787388067.965675:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:6518:x1874211945698432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388067.965685:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388067.965697:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09200/0x26817551a4474744 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447473d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.965718:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09200/0x26817551a4474744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447473d expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.965727:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09200/0x26817551a4474744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447473d expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.965735:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09200, rc 0) 00000100:00100000:0.0:1787388067.965767:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945698432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.965773:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787388067.965813:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945698432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388067.965824:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.965838:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388067.965885:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945698560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.965910:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388067.965926:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388067.965937:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945698560 00000100:00100000:0.0:1787388067.965940:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945698560 00000100:00100000:0.0:1787388067.965959:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787388067.965965:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945698560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.966055:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945698560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.966062:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787388067.966091:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945698560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.966115:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945698688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.966226:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388067.966240:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388067.966251:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945698688 00000100:00100000:0.0:1787388067.966254:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945698688 00000100:00100000:0.0:1787388067.966567:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787388067.966574:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945698688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.966648:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:6518:x1874211945698688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.966655:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787388067.966701:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:530741c0-7948-4b28-86b1-ece4c1322eb9:6518:1874211945698688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388067.967679:0:13807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13807:1874211945698816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388067.967729:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388067.967790:0:13807:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388067.967831:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945698816 00000100:00100000:1.0:1787388067.967836:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945698816 00000100:00100000:1.0:1787388067.967915:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787388067.967922:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:13807:x1874211945698816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388067.968021:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:13807:x1874211945698816:12345-0@lo:502:llog_process_th.0 Request processed in 98us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388067.968029:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787388067.976672:0:13807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13807:1874211945698816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787388067.976732:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388067.976743:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388067.976746:0:13807:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388067.976752:0:13807:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b46a34000 00000020:00000080:2.0:1787388067.976755:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388067.976816:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388067.976819:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388067.976820:0:13807:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388067.976823:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388067.976825:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388067.976826:0:13807:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787388067.976830:0:13807:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b46a34000 00000020:00000080:2.0:1787388067.976831:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787388067.976893:0:13807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13807:1874211945698944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388067.976961:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388067.987666:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945698944 00000100:00100000:0.0:1787388067.987680:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945698944 00000100:00100000:0.0:1787388067.987743:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787388067.987754:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:13807:x1874211945698944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388067.987911:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:13807:x1874211945698944:12345-0@lo:502:llog_process_th.0 Request processed in 158us (10948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388067.987919:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787388067.988602:0:13807:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ee240 going to sleep for 11 seconds 00000100:00100000:2.0:1787388067.990417:0:13807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:530741c0-7948-4b28-86b1-ece4c1322eb9:13807:1874211945698944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787388067.990462:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388067.990471:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388067.990480:0:13807:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787388067.990485:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787388067.991146:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787388067.991172:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787388067.991194:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388067.991204:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388068.077329:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388068.077387:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945699072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388068.077453:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.077618:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945699200:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.077670:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.077694:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945699712:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.077722:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.077741:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945700224:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.077767:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.077798:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787388068.077805:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945699328:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.077834:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.077853:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945699840:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.077873:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.077888:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945700352:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.077910:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.077933:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945699456:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.077959:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.077971:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945699968:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.078000:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.078016:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945700480:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.078039:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.078080:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787388068.078087:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945699584:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.078116:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388068.078131:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945700096:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.078152:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388068.078397:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945699200 00000100:00100000:1.0:1787388068.078405:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945699200 00000100:00100000:1.0:1787388068.078443:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945699712 00000100:00100000:1.0:1787388068.078446:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945699712 00000100:00100000:1.0:1787388068.078472:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945700224 00000100:00100000:1.0:1787388068.078475:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945700224 00000100:00100000:1.0:1787388068.078489:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945699840 00000100:00100000:1.0:1787388068.078492:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945699840 00000100:00100000:1.0:1787388068.078509:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945700352 00000100:00100000:1.0:1787388068.078511:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945700352 00000100:00100000:1.0:1787388068.078529:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945699456 00000100:00100000:1.0:1787388068.078539:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945699456 00000100:00100000:1.0:1787388068.078559:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787388068.078568:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945699200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.078630:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945699200:12345-0@lo:400:kworker.0 Request processed in 62us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.078637:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787388068.078654:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787388068.078662:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945699712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.078695:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945699712:12345-0@lo:400:kworker.0 Request processed in 34us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.078702:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787388068.078715:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787388068.078722:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945700224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.078755:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945700224:12345-0@lo:400:kworker.0 Request processed in 34us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.078762:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787388068.078774:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787388068.078780:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945699840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.078812:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945699840:12345-0@lo:400:kworker.0 Request processed in 32us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.078818:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787388068.078830:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787388068.078836:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945700352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.078868:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945700352:12345-0@lo:400:kworker.0 Request processed in 33us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.078885:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787388068.078899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787388068.078906:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945699456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.078947:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945699456:12345-0@lo:400:kworker.0 Request processed in 42us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.078954:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787388068.078989:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945699968 00000100:00100000:1.0:1787388068.078993:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945699968 00000100:00100000:1.0:1787388068.079022:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945700480 00000100:00100000:1.0:1787388068.079026:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945700480 00000100:00100000:1.0:1787388068.079040:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945700096 00000100:00100000:1.0:1787388068.079043:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945700096 00000100:00100000:1.0:1787388068.079057:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787388068.079063:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945699968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.079096:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945699968:12345-0@lo:400:kworker.0 Request processed in 32us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.079103:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787388068.079500:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787388068.079509:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945700480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.079542:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945700480:12345-0@lo:400:kworker.0 Request processed in 34us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.079547:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787388068.079559:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787388068.079565:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945700096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.079590:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945700096:12345-0@lo:400:kworker.0 Request processed in 27us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.079608:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787388068.079631:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388068.079636:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388068.079638:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388068.079641:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787388068.079677:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43922680 x1874211945699840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388068.079693:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945699840:0@lo:400:kworker.0 00010000:00080000:1.0:1787388068.079707:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c109880 x1874211945700352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388068.079717:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945700352:0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.079730:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945699200:0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.079740:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945699712:0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.079752:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945700224:0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.079795:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945700096:0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.079807:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945699456:0@lo:400:kworker.0 00000100:00100000:1.0:1787388068.079820:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945699968:0@lo:400:kworker.0 00010000:00080000:1.0:1787388068.079831:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c108a80 x1874211945700480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388068.079840:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945700480:0@lo:400:kworker.0 00000100:00100000:2.0:1787388068.081289:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945699072 00000100:00100000:2.0:1787388068.081295:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945699072 00000100:00100000:2.0:1787388068.081342:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787388068.081368:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945699072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388068.081391:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388068.081442:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945699072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388068.081448:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787388068.081470:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945699328 00000100:00100000:2.0:1787388068.081473:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945699328 00000100:00100000:2.0:1787388068.081491:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945699584 00000100:00100000:2.0:1787388068.081493:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945699584 00000100:00100000:2.0:1787388068.081504:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787388068.081510:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945699328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388068.081542:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945699328:12345-0@lo:400:kworker.0 Request processed in 32us (3708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388068.081549:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787388068.081558:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787388068.081564:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945699584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388068.081589:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945699584:12345-0@lo:400:kworker.0 Request processed in 25us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388068.081595:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787388068.081796:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945700608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388068.081844:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388068.081901:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388068.081928:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945699328:0@lo:400:kworker.0 00000100:00100000:3.0:1787388068.082028:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945699584:0@lo:400:kworker.0 00010000:00080000:3.0:1787388068.082040:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43920e00 x1874211945699072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388068.082055:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945699072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388068.082340:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945700608 00000100:00100000:2.0:1787388068.082377:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945700608 00000100:00100000:2.0:1787388068.082415:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787388068.082424:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945700608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388068.082443:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388068.082485:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945700608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388068.082492:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1787388068.082608:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a41180 x1874211945700608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388068.082623:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945700608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388068.097421:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388068.097548:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388068.097718:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925683456 00000100:00100000:1.0:1787388068.097727:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925683456 00000100:00100000:1.0:1787388068.097824:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 247 00000100:00100000:1.0:1787388068.097835:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925683456:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388068.097916:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925683456:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 83us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388068.097924:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 247 00000100:00080000:2.0:1787388068.097925:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388068.097967:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925683328 00000100:00100000:3.0:1787388068.097971:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925683328 00000100:00100000:3.0:1787388068.098016:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 365 00000100:00100000:3.0:1787388068.098023:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+11:2399:x1874211925683328:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388068.098050:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+11:2399:x1874211925683328:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 28us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.098057:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 365 00000100:00100000:3.0:1787388068.098996:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388068.099057:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388068.099090:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925683712 00000100:00100000:2.0:1787388068.099094:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925683712 00000100:00100000:2.0:1787388068.099132:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 91 00000100:00100000:2.0:1787388068.099139:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925683712:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388068.099190:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925683712:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 52us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388068.099197:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 91 00000100:00080000:2.0:1787388068.099219:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388068.104754:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388068.104817:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925683968 00000100:00100000:0.0:1787388068.104826:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925683968 00000100:00100000:0.0:1787388068.104887:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 248 00000100:00100000:0.0:1787388068.104896:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925683968:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388068.104969:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925683968:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 74us (5910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.104977:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 248 00000100:00080000:0.0:1787388068.105754:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388068.107902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388068.108123:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925683584 00000100:00100000:0.0:1787388068.108132:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925683584 00000100:00100000:0.0:1787388068.108215:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925683840 00000100:00100000:0.0:1787388068.108218:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925683840 00000100:00100000:0.0:1787388068.108243:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 249 00000100:00100000:0.0:1787388068.108251:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925683584:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388068.108312:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925683584:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 62us (3580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.108319:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 249 00000100:00100000:0.0:1787388068.108334:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00100000:0.0:1787388068.108340:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925683840:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388068.108643:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925683840:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 301us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.108650:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00080000:2.0:1787388068.109334:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388068.109339:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388068.160460:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388068.160511:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925684096 00000100:00100000:3.0:1787388068.160521:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925684096 00000100:00100000:3.0:1787388068.160574:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 366 00000100:00100000:3.0:1787388068.160583:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+11:6172:x1874211925684096:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388068.160597:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388068.160614:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f7c00/0x26817551a447474b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d93 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388068.160651:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f7c00/0x26817551a447474b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d93 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388068.160663:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f7c00/0x26817551a447474b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d93 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388068.160671:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7c00, rc 0) 00000100:00100000:3.0:1787388068.160730:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925684096:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 145us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.160738:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 366 00000100:00100000:2.0:1787388068.163317:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388068.163385:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925684224 00000100:00100000:0.0:1787388068.163903:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925684224 00000100:00100000:0.0:1787388068.164337:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 367 00000100:00100000:0.0:1787388068.164748:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925684224:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388068.165030:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925684224:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 676us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.165039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 367 00000100:00100000:1.0:1787388068.168300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388068.168394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925684352 00000100:00100000:3.0:1787388068.168403:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925684352 00000100:00100000:3.0:1787388068.168736:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 368 00000100:00100000:3.0:1787388068.168746:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925684352:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388068.169099:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925684352:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 355us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.169106:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 368 00000100:00100000:1.0:1787388068.173511:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388068.178670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925684480 00000100:00100000:0.0:1787388068.178684:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925684480 00000100:00100000:0.0:1787388068.178824:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 369 00000100:00100000:0.0:1787388068.178835:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+12:10814:x1874211925684480:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388068.178987:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+12:10814:x1874211925684480:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 154us (5484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.178995:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 369 00000100:00100000:0.0:1787388068.182722:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388068.186489:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925684608 00000100:00100000:3.0:1787388068.186503:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925684608 00000100:00100000:3.0:1787388068.186567:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 370 00000100:00100000:3.0:1787388068.186578:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+12:10814:x1874211925684608:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388068.186722:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+12:10814:x1874211925684608:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 145us (4008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.186730:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 370 00000100:00100000:1.0:1787388068.191550:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388068.191655:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925684736 00000100:00100000:0.0:1787388068.191664:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925684736 00000100:00100000:0.0:1787388068.191722:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 371 00000100:00100000:0.0:1787388068.191732:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+12:6172:x1874211925684736:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388068.191746:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388068.191765:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09000/0x26817551a4474752 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7d9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388068.191792:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09000/0x26817551a4474752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d9a expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388068.191803:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09000/0x26817551a4474752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d9a expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388068.191814:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09000, rc 0) 00000100:00100000:0.0:1787388068.191873:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:6172:x1874211925684736:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 143us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.191880:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 371 00000100:00100000:1.0:1787388068.194734:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388068.194861:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925684864 00000100:00100000:3.0:1787388068.194870:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925684864 00000100:00100000:3.0:1787388068.194970:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 372 00000100:00100000:3.0:1787388068.194980:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:6172:x1874211925684864:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388068.195115:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:6172:x1874211925684864:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 136us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.195123:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 372 00000100:00100000:1.0:1787388068.203156:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388068.203437:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925684992 00000100:00100000:2.0:1787388068.203448:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925684992 00000100:00100000:2.0:1787388068.203504:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 373 00000100:00100000:2.0:1787388068.203512:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:6172:x1874211925684992:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388068.203755:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:6172:x1874211925684992:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 243us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388068.203764:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 373 00000100:00100000:1.0:1787388068.217717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388068.218382:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925685120 00000100:00100000:3.0:1787388068.218393:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925685120 00000100:00100000:3.0:1787388068.218449:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 374 00000100:00100000:3.0:1787388068.218459:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b701f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:10818:x1874211925685120:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388068.218653:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b701f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:10818:x1874211925685120:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 194us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388068.218662:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 374 00000100:00100000:1.0:1787388068.227667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388068.227989:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925685248 00000100:00100000:0.0:1787388068.228008:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925685248 00000100:00100000:0.0:1787388068.228062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 375 00000100:00100000:0.0:1787388068.228071:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:10818:x1874211925685248:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388068.228258:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:10818:x1874211925685248:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 188us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388068.228267:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 375 00010000:00010000:0.0:1787388068.463259:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388068.973093:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787388068.973557:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787388069.101094:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388069.101116:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945700736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388069.101198:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388069.101309:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945700736 00000100:00100000:2.0:1787388069.101338:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945700736 00000100:00100000:2.0:1787388069.101415:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787388069.101424:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945700736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388069.101456:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388069.101502:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945700736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388069.101509:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787388069.101639:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945700736:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388069.484655:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388070.124833:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388070.124857:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945700864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388070.124927:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388070.125122:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945700864 00000100:00100000:2.0:1787388070.125130:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945700864 00000100:00100000:2.0:1787388070.125201:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787388070.125211:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945700864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388070.125238:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388070.125277:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945700864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388070.125284:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787388070.125427:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945700864:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787388070.125841:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388070.126119:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945700992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388070.126158:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388070.126671:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945700992 00000100:00100000:2.0:1787388070.126678:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945700992 00000100:00100000:2.0:1787388070.126741:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787388070.126750:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945700992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787388070.126767:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388070.126818:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945700992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388070.126825:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1787388070.126946:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388070.127150:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945700992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787388070.508611:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787388070.651437:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1787388071.532722:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388072.172628:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388072.172652:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945701120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388072.172746:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388072.172921:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945701120 00000100:00100000:1.0:1787388072.172937:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945701120 00000100:00100000:1.0:1787388072.173003:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787388072.173012:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945701120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388072.173045:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388072.173106:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945701120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388072.173113:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787388072.173953:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945701120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388072.556751:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388073.196579:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a439d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945701376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388073.196587:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388073.196614:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945701504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388073.196655:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388073.196689:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945701376 00000100:00100000:2.0:1787388073.196709:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945701376 00000100:00080000:3.0:1787388073.196742:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388073.196765:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787388073.196776:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945701376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388073.196784:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787388073.196808:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388073.196823:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945701504 00000100:00100000:3.0:1787388073.196828:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945701504 00000100:00100000:3.0:1787388073.196862:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787388073.196870:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945701504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388073.196883:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388073.196932:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945701504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.196940:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1787388073.196958:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787388073.196985:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a42680 x1874211945701504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388073.197017:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945701504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388073.197057:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945701248:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.197090:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.197123:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945701248 00000100:00100000:3.0:1787388073.197127:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945701248 00000100:00100000:3.0:1787388073.197166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1787388073.197184:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945701248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.197220:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945701248:12345-0@lo:400:kworker.0 Request processed in 47us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.197226:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1787388073.197262:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945701248:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.198706:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945701632:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.198754:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.198782:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945702144:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.198802:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.198821:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388073.198825:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945702016:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.198846:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.198883:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945702016 00000100:00100000:3.0:1787388073.198889:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945702016 00000100:00100000:3.0:1787388073.198923:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787388073.198931:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945702016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.198972:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945702016:12345-0@lo:400:kworker.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.198990:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787388073.199024:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945702016:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.199045:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945701760:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.199069:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.199087:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388073.199093:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945701888:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.199112:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.199135:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945701760 00000100:00100000:3.0:1787388073.199138:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945701760 00000100:00100000:3.0:1787388073.199170:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787388073.199176:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945701760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.199210:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945701760:12345-0@lo:400:kworker.0 Request processed in 32us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.199215:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787388073.199240:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945701760:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.199255:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945701632 00000100:00100000:3.0:1787388073.199257:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945701632 00000100:00100000:3.0:1787388073.199292:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945702144 00000100:00100000:3.0:1787388073.199296:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945702144 00000100:00100000:3.0:1787388073.199316:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945701888 00000100:00100000:3.0:1787388073.199318:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945701888 00000100:00100000:3.0:1787388073.199331:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787388073.199336:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945701632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.199392:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945701632:12345-0@lo:400:kworker.0 Request processed in 56us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.199399:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787388073.199419:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787388073.199425:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945702144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.199450:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945702144:12345-0@lo:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.199456:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787388073.199465:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787388073.199471:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945701888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.199498:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945701888:12345-0@lo:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.199504:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:3.0:1787388073.199520:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388073.199537:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945701632:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.199546:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945702144:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.199567:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945701888:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.200230:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945702528:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.200268:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388073.200290:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388073.200295:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945702656:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.200320:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388073.200361:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945702528 00000100:00100000:1.0:1787388073.200366:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945702528 00000100:00100000:1.0:1787388073.200408:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787388073.200416:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945702528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.204018:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945702272:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.204092:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.204136:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945702784:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.204178:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.204205:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388073.204212:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945702400:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.204236:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388073.204289:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945702656 00000100:00100000:3.0:1787388073.204296:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945702656 00000100:00100000:3.0:1787388073.204358:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945702272 00000100:00100000:3.0:1787388073.204362:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945702272 00000100:00100000:3.0:1787388073.204406:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945702784 00000100:00100000:3.0:1787388073.204409:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945702784 00000100:00100000:3.0:1787388073.204429:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787388073.204436:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945702656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.204489:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945702656:12345-0@lo:400:kworker.0 Request processed in 54us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.204496:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787388073.204509:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787388073.204515:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945702272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.204546:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945702272:12345-0@lo:400:kworker.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.204552:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787388073.204562:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787388073.204567:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945702784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.204591:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945702784:12345-0@lo:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.204609:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00010000:00080000:3.0:1787388073.204652:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a88000 x1874211945702272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388073.204666:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945702272:0@lo:400:kworker.0 00010000:00080000:3.0:1787388073.204676:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a8a680 x1874211945702784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388073.204684:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945702784:0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.204725:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945702400 00000100:00100000:3.0:1787388073.204728:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945702400 00000100:00100000:3.0:1787388073.204763:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787388073.204769:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945702400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388073.204803:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945702400:12345-0@lo:400:kworker.0 Request processed in 34us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.204808:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787388073.204831:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945702400:0@lo:400:kworker.0 00000100:00080000:3.0:1787388073.204858:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388073.204862:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388073.204864:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388073.208839:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945702528:12345-0@lo:400:kworker.0 Request processed in 39us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388073.208849:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945702656:0@lo:400:kworker.0 00000100:00100000:1.0:1787388073.208856:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787388073.208868:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787388073.208875:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996a43a16300, transno 4294967301 00000100:00100000:0.0:1787388073.208900:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945702528:0@lo:400:kworker.0 00000100:00100000:2.0:1787388073.210775:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945701376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13993us (14112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388073.210787:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1787388073.211455:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a439d2300 x1874211945701376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388073.211479:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a439d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945701376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388073.217076:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388073.217118:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388073.217152:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388073.217186:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388073.217228:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388073.217250:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388073.217289:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925685760 00000100:00100000:1.0:1787388073.217299:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925685760 00000100:00100000:1.0:1787388073.217378:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 94 00000100:00100000:1.0:1787388073.217388:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925685760:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388073.217456:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925685760:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.217464:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 94 00000100:00080000:1.0:1787388073.217483:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388073.217496:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925685632 00000100:00100000:1.0:1787388073.217500:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925685632 00000100:00100000:1.0:1787388073.217524:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925685888 00000100:00100000:1.0:1787388073.217527:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925685888 00000100:00100000:1.0:1787388073.217539:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925685504 00000100:00100000:1.0:1787388073.217541:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925685504 00000100:00100000:1.0:1787388073.217552:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925686016 00000100:00100000:1.0:1787388073.217554:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925686016 00000100:00100000:1.0:1787388073.217568:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 257 00000100:00100000:1.0:1787388073.217574:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925685632:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388073.217782:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 258 00000100:00100000:3.0:1787388073.217792:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925685888:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388073.217820:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925685888:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 31us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.217825:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 258 00000100:00100000:3.0:1787388073.217838:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 259 00000100:00100000:3.0:1787388073.217845:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925685504:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388073.217867:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925685504:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.217872:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 259 00000100:00100000:3.0:1787388073.217885:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 260 00000100:00100000:3.0:1787388073.217891:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925686016:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388073.217912:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925686016:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 22us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388073.217918:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 260 00000100:00080000:3.0:1787388073.218054:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388073.218058:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388073.218125:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925685632:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 550us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388073.218133:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 257 00000100:00100000:2.0:1787388073.218525:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925685376 00000100:00100000:2.0:1787388073.218531:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925685376 00000100:00100000:2.0:1787388073.218564:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 377 00000100:00100000:2.0:1787388073.218570:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b45206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2399:x1874211925685376:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388073.218619:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b45206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2399:x1874211925685376:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 49us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388073.218625:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 377 00010000:00010000:2.0:1787388073.580559:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388074.220768:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388074.220792:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945702912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388074.220859:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388074.220975:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945702912 00000100:00100000:1.0:1787388074.220983:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945702912 00000100:00100000:1.0:1787388074.221035:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787388074.221044:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945702912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388074.221077:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388074.221146:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945702912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388074.221154:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787388074.221280:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945702912:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787388074.604650:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388075.244728:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388075.244777:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945703040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388075.244884:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388075.244955:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945703040 00000100:00100000:1.0:1787388075.244974:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945703040 00000100:00100000:3.0:1787388075.244983:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945703168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388075.245015:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388075.245060:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945703168 00000100:00100000:1.0:1787388075.245067:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945703168 00000100:00100000:1.0:1787388075.245095:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787388075.245109:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945703040:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388075.245119:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787388075.245146:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945703168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388075.245153:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1787388075.245173:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388075.245240:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945703040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388075.245249:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1787388075.245408:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388075.248342:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945703168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3198us (3312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388075.248375:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787388075.251526:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945703168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388075.251549:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945703040:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787388075.629656:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388076.653658:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388077.292594:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388077.292619:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945703296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388077.292688:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388077.292760:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945703296 00000100:00100000:3.0:1787388077.292769:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945703296 00000100:00100000:3.0:1787388077.292825:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787388077.292835:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945703296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388077.292870:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388077.292925:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945703296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388077.292940:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787388077.293013:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945703296:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787388077.676595:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388078.190714:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787388078.191461:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787388078.316626:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945703424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388078.316690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388078.316829:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388078.316838:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945703552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388078.316864:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388078.316888:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945703424 00000100:00100000:2.0:1787388078.316894:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945703424 00000100:00100000:2.0:1787388078.316959:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945703552 00000100:00100000:2.0:1787388078.316961:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945703552 00000100:00100000:2.0:1787388078.316986:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787388078.316994:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945703424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388078.317020:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388078.317064:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945703424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388078.317071:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787388078.317085:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787388078.317090:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945703552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388078.317098:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388078.317144:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945703552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388078.317154:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1787388078.317169:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787388078.317195:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a42d80 x1874211945703552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787388078.317195:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a9fb80 x1874211945703424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388078.317213:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945703552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388078.317213:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945703424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388078.317729:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945703680:0@lo:400:kworker.0 00000100:00100000:0.0:1787388078.317768:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388078.317784:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945703808:0@lo:400:kworker.0 00000100:00100000:0.0:1787388078.317799:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945704192:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.317822:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388078.317822:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388078.317841:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945704320:0@lo:400:kworker.0 00000100:00100000:0.0:1787388078.317841:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945704704:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.317859:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388078.317862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388078.317918:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945704064:0@lo:400:kworker.0 00000100:00100000:2.0:1787388078.317995:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945703680 00000100:00100000:2.0:1787388078.318000:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945703680 00000100:00100000:2.0:1787388078.318031:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787388078.318039:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945703680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.326926:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945704832:0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.327189:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388078.327226:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945704576:0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.327264:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388078.327557:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945704704 00000100:00100000:1.0:1787388078.327566:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945704704 00000100:00100000:1.0:1787388078.327618:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945704576 00000100:00100000:1.0:1787388078.327622:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945704576 00000100:00100000:1.0:1787388078.327645:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787388078.327654:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945704704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.327705:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945704704:12345-0@lo:400:kworker.0 Request processed in 52us (9841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.327712:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787388078.327744:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787388078.327750:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945704576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.327783:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945704576:12345-0@lo:400:kworker.0 Request processed in 34us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.327788:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1787388078.327809:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388078.327840:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945704576:0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.327890:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945704192 00000100:00100000:1.0:1787388078.327894:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945704192 00000100:00100000:1.0:1787388078.327945:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787388078.327951:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a439d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945704192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.331682:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a439d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945704192:12345-0@lo:400:kworker.0 Request processed in 3720us (13847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.331698:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787388078.331768:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945703936:0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.331818:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388078.331855:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945704448:0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.331881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388078.331914:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945704960:0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.331946:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388078.332457:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945703808 00000100:00100000:1.0:1787388078.332467:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945703808 00000100:00100000:1.0:1787388078.332502:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945704320 00000100:00100000:1.0:1787388078.332505:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945704320 00000100:00100000:1.0:1787388078.332527:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945704064 00000100:00100000:1.0:1787388078.332530:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945704064 00000100:00100000:1.0:1787388078.332541:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945704448 00000100:00100000:1.0:1787388078.332558:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945704448 00000100:00100000:1.0:1787388078.332573:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945704960 00000100:00100000:1.0:1787388078.332575:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945704960 00000100:00100000:1.0:1787388078.332590:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787388078.332597:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945703808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.332648:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945703808:12345-0@lo:400:kworker.0 Request processed in 51us (14825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.332655:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787388078.332667:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787388078.332673:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945704320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.332697:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945704320:12345-0@lo:400:kworker.0 Request processed in 25us (14837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.332703:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787388078.332713:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787388078.332719:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945704064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.332748:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945704064:12345-0@lo:400:kworker.0 Request processed in 29us (5560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.332754:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787388078.332765:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787388078.332771:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945704448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.332799:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945704448:12345-0@lo:400:kworker.0 Request processed in 28us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.332805:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787388078.332817:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787388078.332823:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945704960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.332849:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945704960:12345-0@lo:400:kworker.0 Request processed in 26us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.332861:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1787388078.332878:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388078.332883:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787388078.334757:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a40380 x1874211945704448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388078.334776:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945704448:0@lo:400:kworker.0 00010000:00080000:1.0:1787388078.334804:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a42a00 x1874211945704960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388078.334813:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945704960:0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.334862:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945704064:0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.334939:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945703936 00000100:00100000:1.0:1787388078.334945:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945703936 00000100:00100000:1.0:1787388078.335543:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787388078.335555:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945703936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.335632:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945703936:12345-0@lo:400:kworker.0 Request processed in 80us (3814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.335639:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787388078.335691:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945703936:0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.337469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388078.337502:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388078.337524:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388078.337549:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388078.337578:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388078.337616:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388078.337653:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925686272 00000100:00100000:1.0:1787388078.337661:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925686272 00000100:00100000:1.0:1787388078.337708:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925686784 00000100:00100000:1.0:1787388078.337711:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925686784 00000100:00100000:1.0:1787388078.337725:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925686400 00000100:00100000:1.0:1787388078.337728:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925686400 00000100:00100000:1.0:1787388078.337739:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925686656 00000100:00100000:1.0:1787388078.337742:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925686656 00000100:00100000:1.0:1787388078.337754:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 266 00000100:00100000:1.0:1787388078.337762:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4494b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925686272:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388078.337827:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4494b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925686272:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 65us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.337836:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 266 00000100:00100000:1.0:1787388078.337853:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 267 00000100:00100000:1.0:1787388078.337859:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925686784:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388078.337884:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925686784:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.337891:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 267 00000100:00100000:1.0:1787388078.337917:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 268 00000100:00100000:1.0:1787388078.337932:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925686400:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388078.337957:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925686400:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.337963:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 268 00000100:00100000:1.0:1787388078.337988:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 269 00000100:00100000:1.0:1787388078.337995:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925686656:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388078.338019:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925686656:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.338031:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 269 00000100:00080000:1.0:1787388078.338058:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388078.338062:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388078.338072:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925686528 00000100:00100000:1.0:1787388078.338075:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925686528 00000100:00100000:2.0:1787388078.340252:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945703680:12345-0@lo:400:kworker.0 Request processed in 22195us (22466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388078.340265:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787388078.340307:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925686144 00000100:00100000:2.0:1787388078.340326:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925686144 00000100:00100000:2.0:1787388078.340616:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 379 00000100:00100000:2.0:1787388078.340625:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925686144:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388078.340676:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925686144:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 52us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388078.340683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 379 00000100:00080000:2.0:1787388078.340867:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388078.340893:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 97 00000100:00100000:2.0:1787388078.340903:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925686528:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388078.340939:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925686528:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 38us (3436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388078.340945:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 97 00000100:00100000:0.0:1787388078.347568:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945704704:0@lo:400:kworker.0 00000100:00100000:0.0:1787388078.347606:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945703680:0@lo:400:kworker.0 00000100:00100000:0.0:1787388078.347617:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945704192:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.348340:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388078.348412:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945703808:0@lo:400:kworker.0 00000100:00100000:3.0:1787388078.348425:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945704320:0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.348431:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945704832 00000100:00100000:1.0:1787388078.348438:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945704832 00000100:00100000:1.0:1787388078.348514:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787388078.348525:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945704832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388078.348593:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945704832:12345-0@lo:400:kworker.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388078.348601:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787388078.348685:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945704832:0@lo:400:kworker.0 00000100:00080000:2.0:1787388078.349831:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787388078.701260:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388079.340595:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388079.340620:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945705088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388079.340694:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388079.340823:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945705088 00000100:00100000:2.0:1787388079.340831:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945705088 00000100:00100000:2.0:1787388079.340881:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787388079.340890:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945705088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388079.340923:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388079.340978:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945705088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388079.340985:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787388079.341087:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945705088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388079.726484:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388080.364592:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388080.364616:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945705216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388080.364622:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388080.364648:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945705344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388080.364694:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388080.364849:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945705216 00000100:00100000:3.0:1787388080.364860:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945705216 00000100:00100000:3.0:1787388080.364952:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787388080.364966:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945705216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388080.365014:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787388080.365041:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388080.374770:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388080.375005:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945705216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10038us (10308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388080.375031:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787388080.375067:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945705216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388080.375075:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945705344 00000100:00100000:3.0:1787388080.375086:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945705344 00000100:00100000:0.0:1787388080.381621:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1787388080.382233:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388080.388844:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945705344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388080.388888:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388080.389009:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945705344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (14251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388080.389153:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787388080.393455:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945705344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787388080.749226:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388081.772711:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388082.412769:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388082.412799:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945705472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388082.412873:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388082.413203:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945705472 00000100:00100000:1.0:1787388082.413213:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945705472 00000100:00100000:1.0:1787388082.413274:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787388082.413284:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945705472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388082.413321:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787388082.413407:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945705472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388082.413415:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787388082.413680:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945705472:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388082.796851:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388083.436691:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945705856:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.436736:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945705728:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.436764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.436784:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.436834:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388083.436842:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945705600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388083.436878:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.436908:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945705600 00000100:00100000:0.0:1787388083.436915:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945705600 00000100:00100000:0.0:1787388083.436966:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787388083.436974:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945705600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388083.437002:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388083.437038:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945705600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.437046:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1787388083.437065:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787388083.437105:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a41180 x1874211945705600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388083.437123:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945705600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388083.437145:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945706240:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.437169:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.437187:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388083.437208:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945706112:0@lo:400:kworker.0 00000100:00100000:0.0:1787388083.437233:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388083.437272:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945705856 00000100:00100000:0.0:1787388083.437276:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945705856 00000100:00100000:0.0:1787388083.437301:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945706240 00000100:00100000:0.0:1787388083.437305:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945706240 00000100:00100000:0.0:1787388083.437322:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787388083.437328:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945705856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.437602:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4337bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945706368:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.437635:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388083.437656:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388083.437662:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945705984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388083.437685:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388083.437711:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945705728 00000100:00100000:2.0:1787388083.437715:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945705728 00000100:00100000:2.0:1787388083.437741:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787388083.437747:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945705728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.437779:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945705728:12345-0@lo:400:kworker.0 Request processed in 32us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.437786:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787388083.437811:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787388083.437818:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945706240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.437842:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945706240:12345-0@lo:400:kworker.0 Request processed in 25us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.437848:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787388083.437877:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945706240:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.437886:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945705728:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.437926:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945705984 00000100:00100000:2.0:1787388083.437929:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945705984 00000100:00100000:2.0:1787388083.437955:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787388083.437969:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945705984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388083.437981:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388083.438000:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945706112 00000100:00100000:3.0:1787388083.438005:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945706112 00000100:00100000:2.0:1787388083.438014:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945705984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.438022:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787388083.438037:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945706368 00000100:00100000:3.0:1787388083.438040:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945706368 00000100:00100000:1.0:1787388083.438067:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787388083.438071:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945706880:0@lo:400:kworker.0 00000100:00100000:1.0:1787388083.438092:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945706112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.438115:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388083.438142:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945706112:12345-0@lo:400:kworker.0 Request processed in 65us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388083.438152:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00080000:2.0:1787388083.438153:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58df80 x1874211945705984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388083.438170:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945705984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388083.438185:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787388083.438185:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787388083.438195:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945706496:0@lo:400:kworker.0 00000100:00100000:1.0:1787388083.438197:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945706368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.438226:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388083.438241:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945706368:12345-0@lo:400:kworker.0 Request processed in 46us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388083.438248:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787388083.438251:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945707008:0@lo:400:kworker.0 00000100:00100000:1.0:1787388083.438275:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945706624:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.438281:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388083.438310:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4337bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945706368:0@lo:400:kworker.0 00000100:00100000:1.0:1787388083.438315:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388083.438338:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945707136:0@lo:400:kworker.0 00000100:00100000:1.0:1787388083.438374:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388083.438391:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388083.438398:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945706752:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.438407:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945706880 00000100:00100000:2.0:1787388083.438412:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945706880 00000100:00100000:1.0:1787388083.438422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388083.438446:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945706752 00000100:00100000:1.0:1787388083.438450:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945706496 00000100:00100000:2.0:1787388083.438451:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945706752 00000100:00100000:1.0:1787388083.438456:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945706496 00000100:00100000:1.0:1787388083.438482:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945707008 00000100:00100000:1.0:1787388083.438486:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945707008 00000100:00100000:2.0:1787388083.438493:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787388083.438505:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945706880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388083.438507:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945706624 00000100:00100000:1.0:1787388083.438512:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945706624 00000100:00100000:1.0:1787388083.438528:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945707136 00000100:00100000:1.0:1787388083.438531:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945707136 00000100:00100000:1.0:1787388083.438551:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787388083.438553:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945706880:12345-0@lo:400:kworker.0 Request processed in 51us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388083.438561:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945706496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.438564:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787388083.438594:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787388083.438603:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945706752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388083.438612:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945706496:12345-0@lo:400:kworker.0 Request processed in 53us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388083.438619:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787388083.438637:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787388083.438645:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945707008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.438650:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945706752:12345-0@lo:400:kworker.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.438658:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787388083.438683:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787388083.438690:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945706624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.438723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945706624:12345-0@lo:400:kworker.0 Request processed in 34us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.438728:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787388083.438739:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787388083.438745:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945707136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.438771:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945707136:12345-0@lo:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.438778:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787388083.438797:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945705856:12345-0@lo:400:kworker.0 Request processed in 1467us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.438807:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787388083.438817:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945706496:0@lo:400:kworker.0 00000100:00100000:2.0:1787388083.438832:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945707008:0@lo:400:kworker.0 00000100:00080000:0.0:1787388083.438835:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388083.438840:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388083.438844:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945706880:0@lo:400:kworker.0 00000100:00080000:0.0:1787388083.438844:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388083.438848:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388083.438859:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945705856:0@lo:400:kworker.0 00000100:00100000:1.0:1787388083.438865:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945707008:12345-0@lo:400:kworker.0 Request processed in 36us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388083.438876:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787388083.438896:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945706112:0@lo:400:kworker.0 00000100:00100000:1.0:1787388083.438922:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945706752:0@lo:400:kworker.0 00010000:00080000:1.0:1787388083.438936:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c109f80 x1874211945706624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388083.438945:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945706624:0@lo:400:kworker.0 00010000:00080000:1.0:1787388083.438954:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c10aa00 x1874211945707136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388083.438961:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945707136:0@lo:400:kworker.0 00000100:00100000:1.0:1787388083.463279:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388083.463333:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388083.463401:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388083.463523:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925687168 00000100:00100000:0.0:1787388083.463533:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925687168 00000100:00100000:0.0:1787388083.463595:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925687040 00000100:00100000:0.0:1787388083.463598:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925687040 00000100:00100000:0.0:1787388083.463621:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 277 00000100:00100000:0.0:1787388083.463629:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925687168:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388083.463709:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925687168:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 80us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.463717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 277 00000100:00100000:0.0:1787388083.463745:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 278 00000100:00100000:0.0:1787388083.463752:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925687040:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388083.463797:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925687040:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 46us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.463803:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 278 00000100:00080000:1.0:1787388083.465145:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388083.465152:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388083.465517:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925686912 00000100:00100000:2.0:1787388083.465525:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925686912 00000100:00100000:2.0:1787388083.465582:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 381 00000100:00100000:2.0:1787388083.465591:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925686912:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388083.465659:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925686912:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 63us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.465677:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 381 00000100:00100000:1.0:1787388083.466846:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388083.467155:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388083.467187:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388083.469474:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925687552 00000100:00100000:0.0:1787388083.469486:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925687552 00000100:00100000:0.0:1787388083.469586:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925687424 00000100:00100000:0.0:1787388083.469589:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925687424 00000100:00080000:1.0:1787388083.469607:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388083.469609:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 279 00000100:00080000:1.0:1787388083.469611:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388083.469637:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925687552:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388083.469719:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925687552:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 88us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388083.469727:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 279 00000100:00100000:0.0:1787388083.469747:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 280 00000100:00100000:0.0:1787388083.469756:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925687424:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388083.469787:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925687424:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 32us (2599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388083.469794:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 280 00000100:00100000:2.0:1787388083.470282:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925687296 00000100:00100000:2.0:1787388083.470288:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925687296 00000100:00100000:2.0:1787388083.470384:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:2.0:1787388083.470391:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2398:x1874211925687296:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:2.0:1787388083.470410:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474679 00000100:00080000:2.0:1787388083.470416:0:8437:0:(import.c:65:import_set_state_nolock()) ffff996a43315000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787388083.470455:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1787388083.470574:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+2:2398:x1874211925687296:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 183us (3733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388083.470582:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00010000:00010000:0.0:1787388083.470699:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787388083.470887:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787388083.820900:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388084.460964:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388084.465163:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945707264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388084.465241:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388084.465556:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945707264 00000100:00100000:2.0:1787388084.465571:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945707264 00000100:00100000:2.0:1787388084.465626:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787388084.465636:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945707264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388084.465669:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388084.465727:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945707264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388084.465733:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787388084.465995:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945707264:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388084.844638:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388085.484765:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388085.484790:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945707392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388085.484859:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388085.485024:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945707392 00000100:00100000:0.0:1787388085.485031:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945707392 00000100:00100000:0.0:1787388085.485099:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787388085.485108:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945707392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388085.485134:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388085.485172:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945707392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388085.485179:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1787388085.485229:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388085.485262:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945707392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388085.489091:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945707520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388085.489156:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388085.489256:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945707520 00000100:00100000:3.0:1787388085.489262:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945707520 00000100:00100000:3.0:1787388085.489330:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787388085.489339:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945707520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388085.489378:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388085.489423:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945707520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388085.489430:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787388085.489475:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945707520:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787388085.489656:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787388085.868647:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388086.893127:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388087.532865:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945707648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388087.532940:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388087.533180:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945707648 00000100:00100000:3.0:1787388087.533188:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945707648 00000100:00100000:3.0:1787388087.533238:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787388087.533247:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945707648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388087.533281:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388087.533337:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945707648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388087.533375:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787388087.533455:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945707648:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388087.919120:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787388088.428919:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787388088.434958:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787388088.556691:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945708032:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.556771:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388088.556828:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945708544:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.556854:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388088.556876:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945709056:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.556896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388088.556922:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787388088.556928:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945707904:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.556948:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388088.556964:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945708416:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.556979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388088.556988:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4337bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945708928:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.556998:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388088.557022:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945708032 00000100:00100000:2.0:1787388088.557027:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945708032 00000100:00100000:2.0:1787388088.557083:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787388088.557092:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945708032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.557143:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945708032:12345-0@lo:400:kworker.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.557151:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787388088.557173:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945708544 00000100:00100000:2.0:1787388088.557177:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945708544 00000100:00100000:2.0:1787388088.557204:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945709056 00000100:00100000:2.0:1787388088.557207:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945709056 00000100:00100000:2.0:1787388088.557225:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945707904 00000100:00100000:2.0:1787388088.557227:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945707904 00000100:00100000:2.0:1787388088.557236:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945708416 00000100:00100000:2.0:1787388088.557238:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945708416 00000100:00100000:2.0:1787388088.557258:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945708928 00000100:00100000:2.0:1787388088.557261:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945708928 00000100:00100000:2.0:1787388088.557273:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787388088.557278:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945708544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.557307:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945708544:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.557313:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787388088.557324:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787388088.557329:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945709056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.557369:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945709056:12345-0@lo:400:kworker.0 Request processed in 40us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.557376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787388088.557387:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787388088.557393:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945707904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.557417:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945707904:12345-0@lo:400:kworker.0 Request processed in 25us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.557423:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787388088.557432:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787388088.557437:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945708416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.557459:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945708416:12345-0@lo:400:kworker.0 Request processed in 22us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.557465:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787388088.557474:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787388088.557479:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945708928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.557498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945708928:12345-0@lo:400:kworker.0 Request processed in 19us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.557509:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:2.0:1787388088.557529:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388088.557533:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388088.557580:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945707904:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.557589:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945708416:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.557598:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4337bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945708928:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.557606:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945708032:0@lo:400:kworker.0 00010000:00080000:2.0:1787388088.557616:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c10b100 x1874211945708544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388088.557626:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945708544:0@lo:400:kworker.0 00010000:00080000:2.0:1787388088.557635:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f570a80 x1874211945709056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388088.557643:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945709056:0@lo:400:kworker.0 00000100:00100000:2.0:1787388088.557664:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388088.557669:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945709440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388088.557693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.557770:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945707776:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.557801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.557828:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945708288:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.557850:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.557867:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945708800:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.557889:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.557905:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945709312:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.557924:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.557942:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787388088.557948:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945708160:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.557980:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.557998:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945708672:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558016:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.558030:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945709184:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558059:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388088.558090:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945708160 00000100:00100000:1.0:1787388088.558094:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945708160 00000100:00100000:1.0:1787388088.558128:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787388088.558134:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945708160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558168:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945708160:12345-0@lo:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.558174:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787388088.558193:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945709440 00000100:00100000:1.0:1787388088.558196:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945709440 00000100:00100000:1.0:1787388088.558224:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787388088.558230:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945709440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388088.558250:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388088.558280:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945709440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.558286:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787388088.558309:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945708288 00000100:00100000:1.0:1787388088.558312:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945708288 00000100:00100000:1.0:1787388088.558332:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787388088.558337:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945708288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558393:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945708288:12345-0@lo:400:kworker.0 Request processed in 55us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.558399:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787388088.558417:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945708800 00000100:00100000:1.0:1787388088.558420:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945708800 00000100:00100000:1.0:1787388088.558435:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945709312 00000100:00100000:1.0:1787388088.558437:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945709312 00000100:00100000:1.0:1787388088.558448:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945708672 00000100:00100000:1.0:1787388088.558450:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945708672 00000100:00100000:1.0:1787388088.558460:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945709184 00000100:00100000:1.0:1787388088.558462:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945709184 00000100:00100000:1.0:1787388088.558471:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787388088.558483:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945708800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558509:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945708800:12345-0@lo:400:kworker.0 Request processed in 28us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.558515:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787388088.558526:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787388088.558531:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945709312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558551:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945709312:12345-0@lo:400:kworker.0 Request processed in 21us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.558557:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787388088.558565:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787388088.558570:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945708672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558588:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945708672:12345-0@lo:400:kworker.0 Request processed in 19us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.558593:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787388088.558602:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787388088.558607:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945709184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558626:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945709184:12345-0@lo:400:kworker.0 Request processed in 19us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.558631:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1787388088.558655:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388088.558658:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388088.558678:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945708160:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558689:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945708672:0@lo:400:kworker.0 00010000:00080000:1.0:1787388088.558699:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f572680 x1874211945709184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388088.558721:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945709184:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558735:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945708288:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.558746:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945708800:0@lo:400:kworker.0 00000100:00100000:3.0:1787388088.558756:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00080000:1.0:1787388088.558758:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f570e00 x1874211945709312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388088.558769:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945709312:0@lo:400:kworker.0 00000100:00100000:3.0:1787388088.558774:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945709568:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787388088.558810:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4390b800 x1874211945709440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388088.558825:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945709440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388088.558827:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388088.558865:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945709568 00000100:00100000:3.0:1787388088.558870:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945709568 00000100:00100000:3.0:1787388088.558905:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787388088.558914:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945709568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388088.558921:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945707776 00000100:00100000:2.0:1787388088.558927:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945707776 00002000:00000024:3.0:1787388088.558928:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388088.558959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787388088.558967:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945707776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388088.558973:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945709568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388088.558982:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787388088.559015:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945707776:12345-0@lo:400:kworker.0 Request processed in 49us (1212us total) trans 0 rc 0/0 00010000:00080000:3.0:1787388088.559021:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58f100 x1874211945709568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388088.559025:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787388088.559048:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945709568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388088.559087:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945707776:0@lo:400:kworker.0 00000100:00100000:1.0:1787388088.577253:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388088.577297:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388088.577319:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925687680 00000100:00100000:2.0:1787388088.577329:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925687680 00000100:00100000:1.0:1787388088.577338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388088.577390:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388088.577401:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 383 00000100:00100000:2.0:1787388088.577412:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b6221c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925687680:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388088.577419:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388088.577443:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925687936 00000100:00100000:1.0:1787388088.577448:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925687936 00000100:00100000:2.0:1787388088.577482:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b6221c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925687680:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 71us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388088.577490:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 383 00000100:00100000:1.0:1787388088.577491:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925688192 00000100:00100000:1.0:1787388088.577497:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925688192 00000100:00100000:1.0:1787388088.577519:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925687808 00000100:00100000:1.0:1787388088.577522:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925687808 00000100:00100000:1.0:1787388088.577540:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925688064 00000100:00100000:1.0:1787388088.577543:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925688064 00000100:00100000:1.0:1787388088.577559:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 287 00000100:00100000:1.0:1787388088.577568:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925687936:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388088.577777:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 288 00000100:00100000:3.0:1787388088.577787:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925688192:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388088.577846:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925687936:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 278us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.577854:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 287 00000100:00100000:1.0:1787388088.577872:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 289 00000100:00100000:1.0:1787388088.577880:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925687808:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388088.580595:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925688192:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 2800us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.580848:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925687808:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 2967us (3456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.580859:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 289 00000100:00100000:1.0:1787388088.580894:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 290 00000100:00100000:1.0:1787388088.580908:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925688064:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388088.580961:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925688064:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 57us (3544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388088.580969:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 290 00000100:00080000:1.0:1787388088.580990:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388088.580996:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388088.583767:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 288 00010000:00010000:2.0:1787388088.947952:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388089.580764:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388089.580818:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945709696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388089.580917:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388089.581016:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945709696 00000100:00100000:2.0:1787388089.581025:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945709696 00000100:00100000:2.0:1787388089.581097:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787388089.581107:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945709696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388089.581152:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388089.581226:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945709696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388089.581234:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787388089.581288:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945709696:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1787388089.589699:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:2.0:1787388089.589714:0:8430:0:(genops.c:906:class_export_put()) final put ffff996a43316000/00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:3.0:1787388089.589801:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a43316000/00e97fed-41ea-4716-be07-f037d23906cf for lustre-OST0000 00000020:00000080:3.0:1787388089.590019:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a43315000 for lustre-OST0000 00010000:00010000:0.0:1787388089.965538:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388090.605522:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388090.605555:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945709824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388090.605557:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945709952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388090.605996:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388090.606074:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945709952 00000100:00100000:0.0:1787388090.606086:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945709952 00000100:00100000:0.0:1787388090.606198:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787388090.606212:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945709952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388090.606265:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388090.606334:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945709952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388090.606343:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787388090.607034:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945709952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388090.607436:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388090.607485:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388090.607539:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945709824 00000100:00100000:0.0:1787388090.607546:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945709824 00000100:00100000:0.0:1787388090.607604:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787388090.607614:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945709824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388090.607636:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388090.607705:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945709824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388090.607713:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787388090.607757:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945709824:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787388090.607863:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787388090.992727:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388092.016611:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388092.660441:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945710080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388092.660520:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388092.660599:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945710080 00000100:00100000:3.0:1787388092.660607:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945710080 00000100:00100000:3.0:1787388092.660654:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787388092.660663:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945710080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388092.660696:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787388092.660743:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945710080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388092.660751:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787388092.660807:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945710080:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787388093.037117:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388093.676546:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388093.676571:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945710208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388093.676662:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.676729:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945710208 00000100:00100000:1.0:1787388093.676739:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945710208 00000100:00100000:1.0:1787388093.677285:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787388093.677300:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945710208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388093.677337:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388093.677421:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945710208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.677429:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1787388093.677455:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787388093.677487:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43afd500 x1874211945710208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388093.677506:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945710208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388093.677719:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388093.677731:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945710336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388093.677780:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388093.677822:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945710336 00000100:00100000:2.0:1787388093.677828:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945710336 00000100:00100000:2.0:1787388093.677866:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787388093.677873:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945710336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388093.677886:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388093.677918:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945710336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388093.677924:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1787388093.677939:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787388093.677955:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f572680 x1874211945710336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388093.677967:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945710336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388093.678315:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945710848:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.678338:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945710592:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.678367:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.678387:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945711360:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.678390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388093.678409:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945711104:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.678412:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.678428:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787388093.678429:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.678433:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945710720:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.678454:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945711616:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.678457:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.678473:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945711232:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.678481:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.678491:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388093.678501:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787388093.678504:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945711744:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.678505:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945710464:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.678523:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388093.678529:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.678541:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945710848 00000100:00100000:3.0:1787388093.678544:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945710976:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.678546:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945710848 00000100:00100000:3.0:1787388093.678566:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.678574:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945710592 00000100:00100000:1.0:1787388093.678578:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945710592 00000100:00100000:3.0:1787388093.678580:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945711488:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.678589:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945711104 00000100:00100000:3.0:1787388093.678598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388093.678598:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945711104 00000100:00100000:1.0:1787388093.678617:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945711616 00000100:00100000:1.0:1787388093.678620:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945711616 00000100:00100000:3.0:1787388093.678630:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945711232 00000100:00100000:3.0:1787388093.678632:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945711232 00000100:00100000:1.0:1787388093.678632:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945711744 00000100:00100000:1.0:1787388093.678634:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945711744 00000100:00100000:1.0:1787388093.678647:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787388093.678653:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945710848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.678692:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945710848:12345-0@lo:400:kworker.0 Request processed in 39us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388093.680096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787388093.680123:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945710592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.680226:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945710592:12345-0@lo:400:kworker.0 Request processed in 119us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388093.680233:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787388093.680254:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787388093.680261:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945711104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.680291:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945711104:12345-0@lo:400:kworker.0 Request processed in 32us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388093.680297:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787388093.680308:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787388093.680315:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945711616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.680377:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787388093.680401:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787388093.680410:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945711744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.680448:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945711744:12345-0@lo:400:kworker.0 Request processed in 41us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.680454:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787388093.680466:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787388093.680472:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945711232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.680498:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945711232:12345-0@lo:400:kworker.0 Request processed in 27us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.680503:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787388093.680534:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945711360 00000100:00100000:1.0:1787388093.680542:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945711360 00000100:00100000:1.0:1787388093.680583:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945711488 00000100:00100000:1.0:1787388093.680587:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945711488 00000100:00100000:1.0:1787388093.680610:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787388093.680616:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945711360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.680648:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945711360:12345-0@lo:400:kworker.0 Request processed in 32us (2235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.680673:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787388093.680685:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787388093.680690:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945711488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.680718:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945711488:12345-0@lo:400:kworker.0 Request processed in 29us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.680724:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787388093.680761:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945710720 00000100:00100000:1.0:1787388093.680766:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945710720 00000100:00100000:1.0:1787388093.680801:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945710976 00000100:00100000:1.0:1787388093.680804:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945710976 00000100:00100000:1.0:1787388093.680817:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787388093.680822:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945710720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.680852:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945710720:12345-0@lo:400:kworker.0 Request processed in 30us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.680857:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787388093.680867:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787388093.680872:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945710976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.680894:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945710976:12345-0@lo:400:kworker.0 Request processed in 22us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.680899:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787388093.680946:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945710720:0@lo:400:kworker.0 00010000:00080000:1.0:1787388093.680961:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f589880 x1874211945711232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388093.680973:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945711232:0@lo:400:kworker.0 00010000:00080000:1.0:1787388093.680984:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4404df80 x1874211945711744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388093.680999:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945711744:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.681024:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945710848:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.681035:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945711360:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.681628:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945711616:12345-0@lo:400:kworker.0 Request processed in 30us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388093.681641:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787388093.681712:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945710976:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.681727:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945711488:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.681741:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945710592:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.684586:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945711104:0@lo:400:kworker.0 00000100:00100000:3.0:1787388093.684629:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945711616:0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.684968:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945710464 00000100:00100000:2.0:1787388093.684978:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945710464 00000100:00100000:2.0:1787388093.685053:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787388093.685065:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945710464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388093.685188:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945710464:12345-0@lo:400:kworker.0 Request processed in 126us (6657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388093.685195:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:2.0:1787388093.685239:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388093.685248:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388093.685252:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388093.685334:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945710464:0@lo:400:kworker.0 00000100:00100000:1.0:1787388093.705981:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388093.706038:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388093.706061:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388093.706079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388093.706101:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388093.706112:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925688576 00000100:00100000:0.0:1787388093.706126:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925688576 00000100:00100000:1.0:1787388093.706133:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925688832 00000100:00100000:1.0:1787388093.706136:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925688832 00000100:00100000:3.0:1787388093.706187:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925688320 00000100:00100000:3.0:1787388093.706191:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925688320 00000100:00100000:3.0:1787388093.706260:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 385 00000100:00100000:3.0:1787388093.706272:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925688320:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388093.706387:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925688320:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 117us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388093.706396:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 385 00000100:00100000:0.0:1787388093.706565:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925688448 00000100:00100000:0.0:1787388093.706569:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925688448 00000100:00100000:3.0:1787388093.706686:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925688704 00000100:00100000:3.0:1787388093.706690:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925688704 00000100:00100000:1.0:1787388093.711755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 297 00000100:00100000:1.0:1787388093.711775:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925688576:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388093.711885:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925688576:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 115us (5845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.711893:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 297 00000100:00100000:1.0:1787388093.711913:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 298 00000100:00100000:1.0:1787388093.711920:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925688832:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388093.711946:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925688832:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (5884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388093.711952:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 298 00000100:00100000:0.0:1787388093.718566:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 299 00000100:00100000:0.0:1787388093.718585:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925688448:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388093.718695:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925688448:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 115us (12613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388093.718705:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 299 00000100:00080000:2.0:1787388093.720220:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388093.720318:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 300 00000100:00100000:2.0:1787388093.720334:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925688704:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388093.720607:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925688704:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 277us (14502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388093.720616:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 300 00000100:00080000:2.0:1787388093.720638:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787388094.062821:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787388094.318072:0:14065:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:41:33 (1787388093) 00000100:00100000:2.0:1787388094.701856:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787388094.701880:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945711872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388094.701948:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388094.702333:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945711872 00000100:00100000:3.0:1787388094.702342:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945711872 00000100:00100000:3.0:1787388094.702417:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787388094.702426:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945711872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388094.702458:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388094.702507:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945711872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388094.702514:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787388094.702698:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945711872:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787388095.085282:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388095.725905:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388095.725931:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4337bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945712000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388095.726034:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388095.730437:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388095.730472:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945712128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388095.730547:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388095.730622:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945712000 00000100:00100000:1.0:1787388095.730643:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945712000 00000100:00100000:1.0:1787388095.730702:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945712128 00000100:00100000:1.0:1787388095.730706:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945712128 00000100:00100000:1.0:1787388095.730725:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787388095.730733:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945712000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388095.730761:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388095.730820:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945712000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (4785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388095.730828:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787388095.730843:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787388095.730849:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945712128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388095.730859:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388095.730910:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945712128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388095.730916:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787388095.731007:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4337bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945712000:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787388095.731111:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388095.732128:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945712128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388095.869120:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388095.869322:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925688960 00000100:00100000:2.0:1787388095.869335:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925688960 00000100:00100000:2.0:1787388095.869480:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:2.0:1787388095.869495:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+5:11107:x1874211925688960:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388095.869522:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388095.869565:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4474759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7da1 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388095.869655:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a4474760 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388095.869672:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a4474760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388095.869687:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a4474760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388095.869779:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787388095.869784:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388095.869828:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a4474760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388095.869859:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4474759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7da1 expref: 7 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388095.869885:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a4474760 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7da1 expref: 6 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388095.869896:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595700) 00010000:00010000:2.0:1787388095.869900:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388095.869903:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e5400, rc 0) 00000100:00100000:2.0:1787388095.869984:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+6:11107:x1874211925688960:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 493us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388095.870002:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00080000:3.0:1787388095.871256:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388095.877799:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388095.877961:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925689088 00000100:00100000:1.0:1787388095.877975:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925689088 00000100:00100000:1.0:1787388095.878126:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:1.0:1787388095.878138:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:11108:x1874211925689088:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388095.878174:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388095.878200:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474767 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7da8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.878289:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a447476e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.878306:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a447476e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.878334:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a447476e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.878880:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4474775 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.878894:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4474775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.878904:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4474775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.878983:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a447477c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.879002:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a447477c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.879508:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a447477c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388095.886710:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388095.886723:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388095.887291:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a447477c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.887315:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a447476e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.887323:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a447476e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.887715:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a447476e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.887723:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388095.887729:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a447476e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.887738:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a447476e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.887759:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595700) 00010000:00010000:1.0:1787388095.887763:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388095.888304:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a447476e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.888314:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a447476e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.888337:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4474775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.888955:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4474775 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.888968:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4474775 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.888974:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077c00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388095.888978:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4474775 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.889025:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4474775 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.889040:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff996b728f7e00) 00010000:00010000:1.0:1787388095.889042:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388095.889046:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4474775 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.889052:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4474775 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.889117:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474767 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7da8 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.889132:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a447477c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7da8 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.889139:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996b728f7300) 00010000:00010000:1.0:1787388095.889141:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388095.889143:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076400, rc 0) 00000100:00100000:1.0:1787388095.889274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+7:11108:x1874211925689088:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 11136us (11487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388095.889285:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:1.0:1787388095.905564:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388095.905733:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925689216 00000100:00100000:3.0:1787388095.905746:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925689216 00000100:00100000:3.0:1787388095.905824:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1787388095.905835:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:00e97fed-41ea-4716-be07-f037d23906cf+7:11108:x1874211925689216:12345-192.168.203.15@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787388095.905977:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:00e97fed-41ea-4716-be07-f037d23906cf+7:11108:x1874211925689216:12345-192.168.203.15@tcp:900:lhsmtool_posix.0 Request processed in 143us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388095.905986:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1787388095.912861:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388095.913120:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925689472 00000100:00100000:1.0:1787388095.913133:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925689472 00000100:00100000:1.0:1787388095.913218:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:1.0:1787388095.913229:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:11108:x1874211925689472:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388095.913275:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388095.913303:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474783 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7daf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.913423:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447478a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.913451:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447478a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.913465:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447478a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.913868:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474791 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.913895:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474791 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.913910:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474791 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914085:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fe00/0x26817551a4474798 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914094:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fe00/0x26817551a4474798 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914100:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fe00/0x26817551a4474798 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388095.914111:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787388095.914208:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447478a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914216:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447478a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914222:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447478a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914228:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077c00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388095.914234:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447478a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914241:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447478a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914255:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996b728f7300) 00010000:00010000:1.0:1787388095.914258:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388095.914262:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447478a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914268:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a447478a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914280:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474791 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914286:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474791 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914292:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474791 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914307:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388095.914310:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474791 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914315:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474791 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914323:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff996b728f7e00) 00010000:00010000:1.0:1787388095.914326:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388095.914328:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474791 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.914334:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077400/0x26817551a4474791 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.916058:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4474783 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7daf expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.916083:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fe00/0x26817551a4474798 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7daf expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388095.916092:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:1.0:1787388095.916095:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388095.916099:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fe00, rc 0) 00000100:00100000:1.0:1787388095.916190:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+9:11108:x1874211925689472:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 2963us (3343us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787388095.916200:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:3.0:1787388095.930597:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388095.933804:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925689600 00000100:00100000:2.0:1787388095.933818:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925689600 00000100:00100000:2.0:1787388095.933903:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:2.0:1787388095.933914:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+9:11108:x1874211925689600:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787388095.934047:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+9:11108:x1874211925689600:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 134us (3467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388095.934055:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:3.0:1787388095.936327:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388095.936486:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925689728 00000100:00100000:1.0:1787388095.936519:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925689728 00000100:00100000:1.0:1787388095.936610:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:0.0:1787388095.936665:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:11108:x1874211925689728:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1787388095.936870:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1787388095.939631:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2900us 00000100:00100000:1.0:1787388096.000237:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:11108:x1874211925689728:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 63606us (63913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388096.000252:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00010000:00010000:0.0:1787388096.108798:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388096.622891:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787388096.626271:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787388097.134855:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388097.772661:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945712256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388097.772770:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388097.772876:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945712256 00000100:00100000:2.0:1787388097.772886:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945712256 00000100:00100000:2.0:1787388097.772945:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787388097.772954:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945712256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388097.773007:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787388097.773057:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945712256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388097.773064:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787388097.773115:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945712256:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388098.162626:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388098.619407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388098.619654:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925689856 00000100:00100000:3.0:1787388098.619668:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925689856 00000100:00100000:3.0:1787388098.619765:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:3.0:1787388098.619778:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+9:11151:x1874211925689856:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388098.619807:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388098.619837:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a44747a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7db6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.619932:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44747ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.619952:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44747ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.619988:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44747ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620006:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44747b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620014:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44747b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620044:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44747b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620394:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44747ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620403:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44747ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620411:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44747ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620418:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388098.620423:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44747ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620432:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44747ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620449:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595700) 00010000:00010000:3.0:1787388098.620453:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388098.620459:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44747ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620466:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a44747ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620480:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44747b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787388098.620633:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787388098.620760:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44747b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620778:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44747b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620783:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388098.620787:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44747b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620794:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44747b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620802:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff996b51436500) 00010000:00010000:3.0:1787388098.620805:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388098.620808:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44747b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620814:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44747b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620859:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a44747a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7db6 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620870:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595700) 00010000:00010000:3.0:1787388098.620873:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388098.620876:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a44747a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7db6 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.620886:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6200, rc 0) 00000100:00100000:3.0:1787388098.621016:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+9:11151:x1874211925689856:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1240us (1620us total) trans 0 rc 301/301 00000100:00100000:3.0:1787388098.621036:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:0.0:1787388098.633856:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388098.634031:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925690112 00000100:00100000:2.0:1787388098.634046:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925690112 00000100:00100000:2.0:1787388098.634130:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:2.0:1787388098.634151:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+9:11151:x1874211925690112:12345-192.168.203.15@tcp:36:lfs.0 00010000:00010000:2.0:1787388098.634233:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388098.634268:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a4474760 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7da1 expref: 9 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.634296:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b58595700) 00010000:00010000:2.0:1787388098.634310:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388098.634419:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.634435:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.634450:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.634478:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.634486:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.634507:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635226:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635242:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635251:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388098.635271:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3ec2a4f reply state 00000000125dd474 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635285:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635292:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388098.635296:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388098.635299:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787388098.635306:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787388098.635315:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635322:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635338:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635375:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388098.635382:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635392:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635405:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b43bd1100) 00010000:00010000:2.0:1787388098.635408:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388098.635411:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635418:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388098.635442:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3ec2a4f reply state 00000000125dd474 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635451:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.635458:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff996b43bd1700) 00010000:00010000:2.0:1787388098.635460:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388098.635463:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787388098.635592:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+10:11151:x1874211925690112:12345-192.168.203.15@tcp:36:lfs.0 Request processed in 1449us (1748us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787388098.635601:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00000040:00080000:0.0:1787388098.672568:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787388098.675456:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787388098.779258:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388098.779305:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925690240 00000100:00100000:0.0:1787388098.779314:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925690240 00000100:00100000:0.0:1787388098.779382:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:0.0:1787388098.779393:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+10:11159:x1874211925690240:12345-192.168.203.15@tcp:101:lctl.0 00010000:00010000:0.0:1787388098.779418:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388098.779443:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44747d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7dbd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388098.779511:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a44747d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388098.779525:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a44747d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388098.779535:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a44747d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388098.779598:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787388098.779603:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388098.779638:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a44747d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388098.779666:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44747d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dbd expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388098.779682:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a44747d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dbd expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388098.779690:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:0.0:1787388098.779693:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388098.779697:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08c00, rc 0) 00000100:00100000:0.0:1787388098.779751:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+11:11159:x1874211925690240:12345-192.168.203.15@tcp:101:lctl.0 Request processed in 360us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388098.779758:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:0.0:1787388098.799372:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945712512:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.799454:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388098.799502:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945713024:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.799531:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388098.799550:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945713536:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.799574:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388098.799591:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945714048:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.799612:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388098.799646:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787388098.799652:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945712640:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.799690:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388098.799712:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945713152:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.799735:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388098.799766:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945713664:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.799787:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388098.799820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945712512 00000100:00100000:0.0:1787388098.799828:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945712512 00000100:00100000:0.0:1787388098.799874:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787388098.799882:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945712512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.800341:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945712512:12345-0@lo:400:kworker.0 Request processed in 459us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388098.800373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787388098.800406:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945713024 00000100:00100000:0.0:1787388098.800409:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945713024 00000100:00100000:0.0:1787388098.800432:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787388098.800479:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945713024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.800511:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945713024:12345-0@lo:400:kworker.0 Request processed in 74us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388098.800518:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787388098.800535:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945712640 00000100:00100000:0.0:1787388098.800538:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945712640 00000100:00100000:0.0:1787388098.800559:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945713152 00000100:00100000:0.0:1787388098.800562:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945713152 00000100:00100000:0.0:1787388098.800586:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945713664 00000100:00100000:0.0:1787388098.800588:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945713664 00000100:00100000:0.0:1787388098.800603:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787388098.800616:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945712640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.800647:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945712640:12345-0@lo:400:kworker.0 Request processed in 33us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388098.800653:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787388098.800666:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787388098.800672:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945713152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.800697:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945713152:12345-0@lo:400:kworker.0 Request processed in 26us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388098.800703:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787388098.800719:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787388098.800725:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945713664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.800805:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945713664:12345-0@lo:400:kworker.0 Request processed in 80us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388098.800812:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787388098.800860:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945712640:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.800871:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945713152:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.800881:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945713664:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.800891:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945712512:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.800966:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945713024:0@lo:400:kworker.0 00000100:00080000:0.0:1787388098.801019:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388098.801030:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945712768:0@lo:400:kworker.0 00000100:00100000:2.0:1787388098.801064:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388098.801087:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945713280:0@lo:400:kworker.0 00000100:00100000:2.0:1787388098.801106:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388098.801121:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945713792:0@lo:400:kworker.0 00000100:00100000:2.0:1787388098.801137:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388098.801163:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787388098.801165:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945713280 00000100:00100000:0.0:1787388098.801170:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945713280 00000100:00100000:2.0:1787388098.801171:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945712384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388098.801193:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388098.801206:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945712896:0@lo:400:kworker.0 00000100:00100000:2.0:1787388098.801221:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388098.801233:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945713408:0@lo:400:kworker.0 00000100:00100000:2.0:1787388098.801251:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388098.801266:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945713920:0@lo:400:kworker.0 00000100:00100000:2.0:1787388098.801283:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388098.801307:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945713792 00000100:00100000:0.0:1787388098.801312:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945713792 00000100:00100000:2.0:1787388098.801320:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945712768 00000100:00100000:2.0:1787388098.801325:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945712768 00000100:00100000:0.0:1787388098.801365:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945712896 00000100:00100000:0.0:1787388098.801371:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945712896 00000100:00100000:2.0:1787388098.801377:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787388098.801386:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945712768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.801396:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787388098.801406:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945713280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388098.801425:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945712768:12345-0@lo:400:kworker.0 Request processed in 40us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388098.801432:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787388098.801452:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945712384 00000100:00100000:2.0:1787388098.801456:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945712384 00000100:00100000:2.0:1787388098.801478:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787388098.801485:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945712384:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388098.801512:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945713280:12345-0@lo:400:kworker.0 Request processed in 107us (402us total) trans 0 rc 0/0 00002000:00000024:2.0:1787388098.801513:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388098.801524:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787388098.801542:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787388098.801553:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945712384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388098.801554:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945713792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388098.801557:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945713536 00000100:00100000:3.0:1787388098.801563:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945713536 00000100:00100000:2.0:1787388098.801566:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787388098.801585:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945714048 00000100:00100000:3.0:1787388098.801588:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945714048 00010000:00080000:2.0:1787388098.801596:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c108a80 x1874211945712384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388098.801606:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945713408 00000100:00100000:3.0:1787388098.801610:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945713408 00000100:00100000:0.0:1787388098.801611:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874211945713792:12345-0@lo:400:kworker.0 Request processed in 61us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388098.801613:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945712384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787388098.801623:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945713920 00000100:00100000:0.0:1787388098.801627:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787388098.801628:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945713920 00000100:00100000:2.0:1787388098.801630:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945712768:0@lo:400:kworker.0 00000100:00100000:3.0:1787388098.801644:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1787388098.801644:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b412ac700 x1874211945713280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388098.801653:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787388098.801655:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945713536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388098.801655:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945713280:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.801667:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945712896:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787388098.801671:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b412aed80 x1874211945713792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388098.801680:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945713792:0@lo:400:kworker.0 00000100:00100000:3.0:1787388098.801698:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945713536:12345-0@lo:400:kworker.0 Request processed in 48us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388098.801704:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787388098.801721:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787388098.801722:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945712896:12345-0@lo:400:kworker.0 Request processed in 56us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388098.801727:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945712896:0@lo:400:kworker.0 00000100:00100000:3.0:1787388098.801729:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945714048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.801737:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787388098.801760:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945714048:12345-0@lo:400:kworker.0 Request processed in 32us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388098.801766:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787388098.801778:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787388098.801784:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945713408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388098.801824:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945713408:12345-0@lo:400:kworker.0 Request processed in 39us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388098.801830:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1787388098.801839:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388098.801844:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388098.801845:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1787388098.801847:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388098.801855:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945713920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.801874:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945713536:0@lo:400:kworker.0 00000100:00100000:2.0:1787388098.801886:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945713408:0@lo:400:kworker.0 00010000:00080000:0.0:1787388098.801959:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b412afb80 x1874211945714048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388098.802106:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945713920:12345-0@lo:400:kworker.0 Request processed in 46us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388098.802114:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1787388098.802258:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b412adc00 x1874211945713920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388098.802265:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945714048:0@lo:400:kworker.0 00000100:00100000:2.0:1787388098.802275:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945713920:0@lo:400:kworker.0 00000100:00100000:0.0:1787388098.805697:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388098.805718:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a44049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945714176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388098.805856:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388098.806004:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945714176 00000100:00100000:2.0:1787388098.806012:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945714176 00000100:00100000:2.0:1787388098.806060:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787388098.806077:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945714176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388098.806099:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388098.806154:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945714176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388098.806161:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:0.0:1787388098.806236:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a44049180 x1874211945714176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388098.806254:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a44049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945714176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388098.828067:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388098.828108:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388098.828144:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388098.828235:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925690368 00000100:00100000:3.0:1787388098.828245:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925690368 00000100:00100000:0.0:1787388098.828258:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388098.828299:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 387 00000100:00100000:3.0:1787388098.828466:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2399:x1874211925690368:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388098.828537:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2399:x1874211925690368:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 230us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388098.828546:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 387 00000100:00100000:2.0:1787388098.828653:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925690496 00000100:00100000:2.0:1787388098.828658:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925690496 00000100:00100000:2.0:1787388098.828704:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925690752 00000100:00100000:2.0:1787388098.828707:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925690752 00000100:00100000:2.0:1787388098.828726:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925690624 00000100:00100000:2.0:1787388098.828728:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925690624 00000100:00100000:2.0:1787388098.828744:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 307 00000100:00100000:2.0:1787388098.828751:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925690496:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388098.828785:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925690496:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 34us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388098.828791:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 307 00000100:00100000:2.0:1787388098.828804:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 308 00000100:00100000:2.0:1787388098.828811:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925690752:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388098.828833:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925690752:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388098.828839:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 308 00000100:00100000:2.0:1787388098.828852:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 309 00000100:00100000:2.0:1787388098.828858:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925690624:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388098.828880:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925690624:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388098.828901:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 309 00000100:00080000:3.0:1787388098.828986:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388098.828990:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388098.860571:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388098.861023:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925690880 00000100:00100000:2.0:1787388098.861033:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925690880 00000100:00100000:2.0:1787388098.861123:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:2.0:1787388098.861133:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+11:11165:x1874211925690880:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388098.861153:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388098.861172:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7dc4 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861234:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a44747e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861247:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a44747e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861258:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a44747e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861268:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5a00/0x26817551a44747ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861274:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5a00/0x26817551a44747ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861280:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5a00/0x26817551a44747ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861391:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a44747f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861417:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a44747f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861424:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a44747f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388098.861458:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787388098.861462:0:10197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388098.861494:0:10197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a44747f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861506:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a44747e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861513:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a44747e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861519:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a44747e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861525:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388098.861529:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a44747e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861536:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a44747e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861547:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:2.0:1787388098.861550:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388098.861555:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a44747e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861570:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5400/0x26817551a44747e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861584:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5a00/0x26817551a44747ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861590:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5a00/0x26817551a44747ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861595:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5a00/0x26817551a44747ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861600:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388098.861603:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5a00/0x26817551a44747ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861608:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5a00/0x26817551a44747ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861616:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff996b43bd1700) 00010000:00010000:2.0:1787388098.861618:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388098.861621:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5a00/0x26817551a44747ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861626:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5a00/0x26817551a44747ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861651:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a44747de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dc4 expref: 13 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861676:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a44747f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dc4 expref: 12 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.861683:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388098.861686:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787388098.861688:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e5000, rc 0) 00000100:00100000:2.0:1787388098.861757:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+12:11165:x1874211925690880:12345-192.168.203.15@tcp:101:bash.0 Request processed in 625us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388098.862449:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:0.0:1787388098.866083:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388098.866311:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925691136 00000100:00100000:2.0:1787388098.866323:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925691136 00000100:00100000:2.0:1787388098.866423:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:2.0:1787388098.866433:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+12:11165:x1874211925691136:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388098.866455:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388098.866477:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a44747fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7dcb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.866602:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474801 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.866615:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474801 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.866625:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474801 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.866684:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.866700:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.866707:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388098.868016:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787388098.868646:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868657:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868664:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868689:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474801 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868693:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474801 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868698:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474801 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868701:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388098.868704:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474801 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868709:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474801 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868742:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388098.868745:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388098.868749:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474801 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868755:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474801 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388098.868771:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005a4ceaa6 reply state 00000000d9ea46ca transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868782:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868788:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b43bd1100) 00010000:00010000:2.0:1787388098.868790:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388098.868793:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787388098.868831:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a44747fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dcb expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868847:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dcb expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388098.868854:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1b00) 00010000:00010000:2.0:1787388098.868857:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388098.868859:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5de00, rc 0) 00000100:00100000:2.0:1787388098.868928:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:11165:x1874211925691136:12345-192.168.203.15@tcp:101:bash.0 Request processed in 2495us (2853us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787388098.868936:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:3.0:1787388098.879022:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388098.879728:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925691264 00000100:00100000:0.0:1787388098.879738:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925691264 00000100:00100000:0.0:1787388098.879991:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:0.0:1787388098.879999:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874211925691264:12345-192.168.203.15@tcp:8:bash.0 00010000:00080000:0.0:1787388098.880031:0:8490:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:0.0:1787388098.880059:0:8490:0:(genops.c:1406:class_connect()) connect: client 00e97fed-41ea-4716-be07-f037d23906cf, cookie 0x26817551a447481d 00002000:00100000:0.0:1787388098.880071:0:8490:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 00e97fed-41ea-4716-be07-f037d23906cf/ffff996a44055800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787388098.880082:0:8490:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787388098.880147:0:8490:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787388098.880173:0:8490:0:(import.c:65:import_set_state_nolock()) ffff996a44052000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388098.880236:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2398:x1874211925691264:12345-192.168.203.15@tcp:8:bash.0 Request processed in 237us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388098.880244:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:0.0:1787388098.884707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388098.884815:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925691392 00000100:00100000:1.0:1787388098.884827:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925691392 00000100:00100000:1.0:1787388098.884913:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:1.0:1787388098.884932:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:0:x1874211925691392:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388098.884950:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388098.884981:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a4474824 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7dd2 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388098.885007:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388098.885026:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1787388098.885030:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388098.885040:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a4474824 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd2 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388098.885071:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a4474824 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd2 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388098.885085:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e800, rc 0) 00000100:00100000:1.0:1787388098.885144:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:0:x1874211925691392:12345-192.168.203.15@tcp:101:bash.0 Request processed in 214us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388098.885167:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00080000:3.0:1787388098.885377:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388098.889227:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388098.889424:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925691520 00000100:00100000:1.0:1787388098.889434:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925691520 00000100:00100000:1.0:1787388098.889494:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:1.0:1787388098.889505:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+7:11165:x1874211925691520:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388098.889523:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388098.889540:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7dd9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388098.889571:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a4474824 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd2 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388098.889579:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388098.889583:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388098.889589:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388098.889623:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a4474824 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd2 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388098.889636:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a4474824 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd2 expref: 8 pid: 8434 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388098.889649:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874211945714304:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388098.889742:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388098.893753:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388098.894250:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874211945714304:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388098.894438:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388098.894460:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ea00, rc 0) 00000100:00100000:1.0:1787388098.894524:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:11165:x1874211925691520:12345-192.168.203.15@tcp:101:bash.0 Request processed in 5020us (5305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388098.894533:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:3.0:1787388098.895382:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925691648 00000100:00100000:3.0:1787388098.895390:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925691648 00010000:00010000:3.0:1787388098.895425:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a4474824 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd2 expref: 8 pid: 8434 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388098.895466:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:3.0:1787388098.895475:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925691648:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388098.895489:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388098.895525:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a4474824 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd2 expref: 8 pid: 8434 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.895732:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a4474824 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd2 expref: 8 pid: 8434 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.895867:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a4474824 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd2 expref: 8 pid: 8434 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.896282:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388098.896287:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388098.896297:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.896309:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388098.896394:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388098.896410:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1874211945714432:192.168.203.15@tcp:105: 00000100:00100000:3.0:1787388098.896493:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74fe0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787388098.898299:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1874211945714432:192.168.203.15@tcp:105: 00010000:00010000:3.0:1787388098.898322:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388098.898413:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:2401:x1874211925691648:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 2938us (4669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388098.898424:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:2.0:1787388098.899529:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388098.899605:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925691904 00000100:00100000:0.0:1787388098.899613:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925691904 00000100:00100000:0.0:1787388098.899659:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:0.0:1787388098.899668:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:11165:x1874211925691904:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:0.0:1787388098.899979:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+16:11165:x1874211925691904:12345-192.168.203.15@tcp:35:bash.0 Request processed in 303us (447us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787388098.899988:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:2.0:1787388099.017561:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.017679:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925692160 00000100:00100000:0.0:1787388099.017689:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925692160 00000100:00100000:0.0:1787388099.017753:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:0.0:1787388099.017763:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+16:11175:x1874211925692160:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388099.017788:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388099.017809:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a4474832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7de0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388099.017910:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787388099.018020:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a4474832 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7de0 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.018035:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:0.0:1787388099.018038:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388099.018043:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a4474832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7de0 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.018058:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09400, rc 0) 00000100:00100000:0.0:1787388099.018122:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+17:11175:x1874211925692160:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 360us (570us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1787388099.018157:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:1.0:1787388099.023196:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.025977:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925692416 00000100:00100000:0.0:1787388099.025993:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925692416 00000100:00100000:0.0:1787388099.026070:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1787388099.026081:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+17:11175:x1874211925692416:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1787388099.026304:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:11175:x1874211925692416:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 224us (3116us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787388099.026313:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1787388099.125326:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388099.125768:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925692544 00000100:00100000:1.0:1787388099.125778:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925692544 00000100:00100000:1.0:1787388099.125901:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:1.0:1787388099.125913:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+18:11181:x1874211925692544:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388099.125937:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388099.125958:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7de7 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.126033:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474847 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.126047:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.126057:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388099.126102:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787388099.126105:0:10197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388099.126124:0:10197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.126162:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7de7 expref: 20 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.126179:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474847 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7de7 expref: 19 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.126187:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:1.0:1787388099.126190:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388099.126193:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e200, rc 0) 00000100:00100000:1.0:1787388099.126262:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+19:11181:x1874211925692544:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 351us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388099.126269:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:2.0:1787388099.133841:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.133980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925692800 00000100:00100000:0.0:1787388099.133990:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925692800 00000100:00100000:0.0:1787388099.134049:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:0.0:1787388099.134060:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+19:11181:x1874211925692800:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388099.134080:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388099.134101:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447484e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7dee expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.134542:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4474855 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.134557:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4474855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.134568:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4474855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388099.134579:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787388099.134884:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447484e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dee expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.134922:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4474855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dee expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.134930:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1b00) 00010000:00010000:0.0:1787388099.134933:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388099.134936:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08000, rc 0) 00000100:00100000:0.0:1787388099.136757:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+21:11181:x1874211925692800:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 2690us (3637us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787388099.136768:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:2.0:1787388099.145467:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388099.145568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.145656:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925693184 00000100:00100000:0.0:1787388099.145667:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925693184 00000100:00100000:0.0:1787388099.145730:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:0.0:1787388099.145741:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+21:11181:x1874211925693184:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388099.145765:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388099.145785:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a4474863 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7df5 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.145881:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a447486a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.145894:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a447486a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.145906:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a447486a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388099.145917:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787388099.146036:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a4474863 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7df5 expref: 24 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.146053:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a447486a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7df5 expref: 23 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.146061:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1b00) 00010000:00010000:0.0:1787388099.146064:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787388099.146067:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08200, rc 0) 00000100:00100000:0.0:1787388099.146130:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+23:11181:x1874211925693184:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 392us (562us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787388099.146138:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:3.0:1787388099.147148:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925692928 00000100:00100000:3.0:1787388099.147156:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925692928 00000100:00100000:3.0:1787388099.147209:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:3.0:1787388099.147218:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+23:2400:x1874211925692928:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388099.147228:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388099.147247:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4474855 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dee expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388099.147261:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1b00) 00010000:00010000:3.0:1787388099.147265:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388099.147303:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+22:2400:x1874211925692928:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 86us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388099.147309:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:2.0:1787388099.164682:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388099.164776:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925693312 00000100:00100000:1.0:1787388099.164785:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925693312 00000100:00100000:1.0:1787388099.164837:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:1.0:1787388099.164845:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925693312:12345-192.168.203.15@tcp:1:lfs.0 00010000:00010000:1.0:1787388099.164887:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.164906:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.164916:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388099.164920:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388099.164925:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.164987:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.165000:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 7 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388099.165016:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874211945714560:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388099.165100:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388099.168014:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.168118:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925693440 00000100:00100000:0.0:1787388099.168127:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925693440 00002000:00100000:0.0:1787388099.168178:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff996a4223d880 x1874211925693440/t0(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:355/0 lens 504/0 e 0 to 0 dl 1787388110 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388099.168188:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a4223d880 with x1874211925693440 ext(0->12) 00010000:00010000:0.0:1787388099.168196:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 8 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.168210:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 8 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388099.168218:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996a4223d880 00000100:00100000:0.0:1787388099.168247:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1787388099.168256:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925693440:12345-192.168.203.15@tcp:4:lfs.0 00000100:00100000:1.0:1787388099.168810:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874211945714560:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388099.168838:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787388099.175597:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000100:00100000:0.0:1787388099.176487:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+9:2401:x1874211925693440:12345-192.168.203.15@tcp:4:lfs.0 Request processed in 8223us (8474us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787388099.176510:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00002000:00100000:0.0:1787388099.176525:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff996a4223d880 x1874211925693440/t4294967300(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:355/0 lens 504/448 e 0 to 0 dl 1787388110 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388099.176536:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a4223d880 with x1874211925693440 ext(0->12) 00010000:00010000:0.0:1787388099.176546:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 9 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.176565:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 9 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388099.176574:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996a4223d880 00010000:00010000:0.0:1787388099.184119:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388099.184504:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.184630:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925693568 00000100:00100000:0.0:1787388099.184639:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925693568 00010000:00010000:0.0:1787388099.184739:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 9 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388099.184814:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:0.0:1787388099.184825:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+9:2402:x1874211925693568:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388099.184839:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787388099.184864:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787388099.184867:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787388099 00002000:00010000:0.0:1787388099.184869:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787388099 00002000:00010000:0.0:1787388099.184871:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787388099 00002000:00010000:0.0:1787388099.184872:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787388099.184891:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 9 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.184904:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 9 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.184931:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068539781/0x26817551a447482b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dd9 expref: 9 pid: 8436 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.185070:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388099.185076:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388099.185082:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.185093:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.185294:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388099.185428:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925693568:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 603us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.185436:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00010000:00010000:1.0:1787388099.185567:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.185578:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.185600:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.185609:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.185629:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.185636:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fa00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388099.185641:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.185650:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.185672:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.185679:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474878 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388099.185735:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925693312:12345-192.168.203.15@tcp:1:lfs.0 Request processed in 20890us (21060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388099.185743:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:2.0:1787388099.189078:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388099.190568:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925693824 00000100:00100000:3.0:1787388099.190582:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925693824 00000100:00100000:3.0:1787388099.190641:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:3.0:1787388099.190652:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+22:11181:x1874211925693824:12345-192.168.203.15@tcp:35:lfs.0 00000004:00010000:3.0:1787388099.190811:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a447486a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7df5 expref: 22 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388099.191035:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1787388099.191073:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787388099.192734:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1787388099.192806:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388099.192826:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dcb expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388099.192851:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388099.192890:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dcb expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388099.192905:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dcb expref: 26 pid: 6521 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388099.192919:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874211945714688:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388099.193082:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74fe0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388099.197017:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.197583:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925693952 00000100:00100000:0.0:1787388099.197592:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925693952 00010000:00010000:0.0:1787388099.197636:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dcb expref: 27 pid: 6521 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388099.197768:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:0.0:1787388099.197779:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+27:2401:x1874211925693952:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388099.197805:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388099.197812:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dcb expref: 27 pid: 6521 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.197823:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dcb expref: 27 pid: 6521 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388099.197829:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874211945714688:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388099.197846:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447480f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dcb expref: 27 pid: 6521 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388099.197850:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.197862:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1b00) 00010000:00010000:0.0:1787388099.197867:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.197876:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.197883:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.197911:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388099.197976:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+26:2401:x1874211925693952:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 189us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.197984:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 54 00010000:00010000:3.0:1787388099.198031:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388099.198039:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388099.201632:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1787388099.202029:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1787388099.202316:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945714816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787388099.202538:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388099.202607:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f21600 going to sleep for 11 seconds 00000100:00100000:0.0:1787388099.202735:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945714816 00000100:00100000:0.0:1787388099.202819:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945714816 00000100:00100000:0.0:1787388099.202912:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787388099.202922:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874211945714816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787388099.203035:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874211945714816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 114us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.203058:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787388099.203156:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945714816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787388099.203321:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1787388099.203627:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945714944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787388099.205734:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388099.205771:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517f6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388099.206444:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945714944 00000100:00100000:0.0:1787388099.206454:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945714944 00000100:00100000:0.0:1787388099.206541:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787388099.206550:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1874211945714944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787388099.206733:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1874211945714944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 184us (1004us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787388099.206752:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787388099.207265:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945714944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787388099.207333:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1787388099.208470:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.208484:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.208491:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.208497:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388099.208502:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.208528:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.208543:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1b00) 00010000:00010000:2.0:1787388099.208546:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787388099.208551:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.208557:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a447487f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388099.208719:0:6523:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787388099.208773:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787388099.208783:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420731435897ns, next at 421731434349ns, rc = 0 00000001:00080000:2.0:1787388099.208790:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1787388099.208818:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1b00) 00010000:00010000:2.0:1787388099.208821:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787388099.208828:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a447486a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7df5 expref: 30 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388099.208946:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+29:11181:x1874211925693824:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 18295us (19874us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787388099.208956:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000020:00080000:2.0:1787388099.208962:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787388099.211919:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388099.212028:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925694080 00000100:00100000:1.0:1787388099.212039:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925694080 00000100:00100000:1.0:1787388099.212096:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:1.0:1787388099.212105:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+29:11181:x1874211925694080:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388099.212125:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388099.212335:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474886 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7dfc expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.213263:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474886 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dfc expref: 30 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.213286:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474886 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dfc expref: 30 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.213311:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388099.213315:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388099.213319:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fa00, rc 0) 00000100:00100000:1.0:1787388099.213423:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+30:11181:x1874211925694080:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1317us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388099.213444:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:0.0:1787388099.217958:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388099.218008:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925694336 00000100:00100000:2.0:1787388099.218016:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925694336 00000100:00100000:2.0:1787388099.218059:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:2.0:1787388099.218067:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dccdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+30:11181:x1874211925694336:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388099.218312:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dccdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+31:11181:x1874211925694336:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 244us (361us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787388099.218320:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:3.0:1787388099.302784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.302987:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925694592 00000100:00100000:0.0:1787388099.302998:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925694592 00000100:00100000:0.0:1787388099.303064:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:0.0:1787388099.303074:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+31:11191:x1874211925694592:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388099.303101:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388099.303123:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a447488d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388099.303243:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787388099.303412:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a447488d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e03 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.303428:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:0.0:1787388099.303431:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388099.303436:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a447488d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e03 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.303452:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08200, rc 0) 00000100:00100000:0.0:1787388099.303528:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+32:11191:x1874211925694592:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 455us (752us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1787388099.303536:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:3.0:1787388099.306875:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.307008:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925694720 00000100:00100000:0.0:1787388099.307018:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925694720 00000100:00100000:0.0:1787388099.307081:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:0.0:1787388099.307101:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+32:11191:x1874211925694720:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:0.0:1787388099.307187:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447489b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307204:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447489b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307217:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447489b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307229:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44748a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307237:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44748a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307244:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44748a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307321:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307329:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307336:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388099.307415:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307428:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447489b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307434:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447489b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307441:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447489b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307448:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388099.307452:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447489b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307459:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447489b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307471:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:0.0:1787388099.307474:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388099.307479:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447489b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307485:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a447489b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307499:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44748a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307506:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44748a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307519:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44748a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307524:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388099.307527:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44748a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307532:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44748a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307541:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b43bd1100) 00010000:00010000:0.0:1787388099.307543:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388099.307546:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44748a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307552:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44748a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.307562:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.309750:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.309759:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.309765:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388099.309770:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.309799:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.309815:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:0.0:1787388099.309819:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388099.309823:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.309829:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388099.309950:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+32:11191:x1874211925694720:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 2856us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.309961:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:3.0:1787388099.316192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388099.316284:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925694976 00000100:00100000:2.0:1787388099.316294:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925694976 00000100:00100000:2.0:1787388099.316376:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:2.0:1787388099.316388:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+32:11191:x1874211925694976:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388099.316657:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+33:11191:x1874211925694976:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 271us (474us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787388099.316665:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:3.0:1787388099.399304:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388099.400509:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925695232 00000100:00100000:1.0:1787388099.400522:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925695232 00000100:00100000:1.0:1787388099.400596:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:1.0:1787388099.400605:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+33:11195:x1874211925695232:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388099.400629:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388099.400649:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44748b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e0a expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.400721:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44748b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.400736:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44748b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.400763:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44748b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.400775:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44748be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.400783:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44748be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.400789:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44748be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.400900:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.400909:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.400916:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388099.400936:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787388099.401038:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44748b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401046:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44748b7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401053:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44748b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401058:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388099.401068:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44748b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401076:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44748b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401090:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:1.0:1787388099.401093:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388099.401097:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44748b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401104:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44748b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401128:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44748be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401134:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44748be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401139:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44748be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401144:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388099.401147:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44748be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401153:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44748be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401159:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b43bd1100) 00010000:00010000:1.0:1787388099.401161:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388099.401169:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44748be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401175:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44748be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401212:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44748b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e0a expref: 36 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401226:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e0a expref: 35 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.401233:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388099.401236:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388099.401238:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e400, rc 0) 00000100:00100000:1.0:1787388099.401310:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+35:11195:x1874211925695232:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 705us (2016us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787388099.401318:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:3.0:1787388099.410319:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.411921:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925695360 00000100:00100000:0.0:1787388099.411934:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925695360 00000100:00100000:0.0:1787388099.412023:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:0.0:1787388099.412034:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+35:11195:x1874211925695360:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:0.0:1787388099.412098:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.412114:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.412124:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.412159:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.412184:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.412190:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.412197:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388099.412201:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.412210:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.412223:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:0.0:1787388099.412226:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388099.412231:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.412238:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388099.412330:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+35:11195:x1874211925695360:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 298us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.412339:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:3.0:1787388099.417679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388099.417842:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925695616 00000100:00100000:2.0:1787388099.417853:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925695616 00000100:00100000:2.0:1787388099.417909:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:2.0:1787388099.417918:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+35:11195:x1874211925695616:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388099.418155:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+36:11195:x1874211925695616:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 237us (484us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787388099.418164:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:2.0:1787388099.749477:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.749704:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925695872 00000100:00100000:0.0:1787388099.749715:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925695872 00000100:00100000:0.0:1787388099.749828:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:0.0:1787388099.749839:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+36:11226:x1874211925695872:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:0.0:1787388099.749864:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388099.749897:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e11 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.750115:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44748e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.750130:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44748e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.750144:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44748e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388099.750155:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787388099.750266:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e11 expref: 39 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.750285:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44748e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e11 expref: 38 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.750295:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:0.0:1787388099.750298:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388099.750301:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031a00, rc 0) 00000100:00100000:0.0:1787388099.750407:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+38:11226:x1874211925695872:12345-192.168.203.15@tcp:101:cat.0 Request processed in 570us (939us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787388099.750414:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:3.0:1787388099.754940:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388099.755998:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.756454:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925696256 00000100:00100000:0.0:1787388099.756469:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925696256 00000100:00100000:0.0:1787388099.756554:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:0.0:1787388099.756574:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+38:2402:x1874211925696256:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388099.756604:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388099.756628:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44748e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e11 expref: 38 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.756646:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:0.0:1787388099.756651:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388099.756728:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+37:2402:x1874211925696256:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 164us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388099.756735:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:2.0:1787388099.757689:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925696128 00000100:00100000:2.0:1787388099.757698:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925696128 00000100:00100000:2.0:1787388099.757741:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:2.0:1787388099.757750:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+37:11226:x1874211925696128:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:2.0:1787388099.758465:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+38:11226:x1874211925696128:12345-192.168.203.15@tcp:35:cat.0 Request processed in 713us (3544us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1787388099.758474:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:0.0:1787388099.823222:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388099.823248:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945715072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388099.823319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388099.827698:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945715072 00000100:00100000:1.0:1787388099.827715:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945715072 00000100:00100000:1.0:1787388099.827959:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787388099.827999:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945715072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388099.828037:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388099.828122:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945715072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (4802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388099.828130:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787388099.828222:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945715072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388099.833423:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.833602:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925696512 00000100:00100000:0.0:1787388099.833611:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925696512 00000100:00100000:0.0:1787388099.833669:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:0.0:1787388099.833678:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+38:11232:x1874211925696512:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:0.0:1787388099.833704:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388099.833707:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787388099.833735:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474847 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7de7 expref: 38 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.833753:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:0.0:1787388099.833758:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388099.833772:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44748ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.833902:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.833917:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e0a expref: 38 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.833924:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.833956:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e0a expref: 38 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.833980:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e0a expref: 38 pid: 10197 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388099.833995:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945715200:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388099.834083:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b729819c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388099.837574:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388099.838330:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925696640 00000100:00100000:1.0:1787388099.838340:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925696640 00010000:00010000:1.0:1787388099.838405:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e0a expref: 39 pid: 10197 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388099.838455:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:1.0:1787388099.838465:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+39:2401:x1874211925696640:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388099.838480:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388099.838487:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e0a expref: 39 pid: 10197 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.838622:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e0a expref: 39 pid: 10197 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.838650:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388099.838654:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.838663:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.838670:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.838690:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388099.838858:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+39:2401:x1874211925696640:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 394us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388099.838868:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00010000:00010000:1.0:1787388099.838921:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44748c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e0a expref: 38 pid: 10197 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388099.838936:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945715200:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388099.838975:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.838984:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.838989:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388099.839005:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787388099.839172:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44748ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e18 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.839188:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e18 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388099.839196:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388099.839198:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388099.839201:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031200, rc 0) 00000100:00100000:1.0:1787388099.839227:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+38:11232:x1874211925696512:12345-192.168.203.15@tcp:101:dd.0 Request processed in 5549us (5813us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787388099.839234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:3.0:1787388099.852839:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388099.853091:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925696768 00000100:00100000:2.0:1787388099.853100:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925696768 00000100:00100000:2.0:1787388099.853177:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1787388099.853187:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+38:11232:x1874211925696768:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:2.0:1787388099.853210:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388099.853229:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a4474904 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e1f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.853266:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.853280:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.853291:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.853448:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a4474904 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e1f expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.853468:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e1f expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388099.853476:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:2.0:1787388099.853479:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787388099.853483:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5ca00, rc 0) 00000100:00100000:2.0:1787388099.853720:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+39:11232:x1874211925696768:12345-192.168.203.15@tcp:101:dd.0 Request processed in 533us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388099.853803:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:3.0:1787388099.864664:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388099.864848:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925697024 00000100:00100000:0.0:1787388099.864858:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925697024 00000100:00100000:0.0:1787388099.864919:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:0.0:1787388099.864929:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+39:11232:x1874211925697024:12345-192.168.203.15@tcp:36:dd.0 00010000:00010000:0.0:1787388099.865180:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.865197:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.865208:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388099.865263:0:13515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1787388099.865285:0:13515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7eeb928 reply state 00000000ee0c5f55 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.865299:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388099.865306:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:0.0:1787388099.865308:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388099.865312:0:13515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787388099.865435:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+42:11232:x1874211925697024:12345-192.168.203.15@tcp:36:dd.0 Request processed in 506us (778us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787388099.865442:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00000020:00080000:0.0:1787388099.865447:0:13515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787388100.107513:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388100.107772:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925697152 00000100:00100000:1.0:1787388100.107785:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925697152 00000100:00100000:1.0:1787388100.107880:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:1.0:1787388100.107895:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+42:11247:x1874211925697152:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:1.0:1787388100.107927:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388100.107953:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474919 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108056:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474920 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108072:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108084:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108097:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474927 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108104:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108112:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108222:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108234:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e18 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108243:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108283:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e18 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.108310:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e18 expref: 43 pid: 6520 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388100.108326:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945715328:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388100.108496:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fe40 going to sleep for 11 seconds 00000100:00080000:3.0:1787388100.108940:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388100.112882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388100.113137:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925697408 00000100:00100000:0.0:1787388100.113153:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925697408 00000100:00100000:1.0:1787388100.113182:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945715328:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388100.113221:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388100.113260:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:0.0:1787388100.113272:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+44:10803:x1874211925697408:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787388100.113686:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+45:10803:x1874211925697408:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 413us (812us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787388100.113695:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:2.0:1787388100.119676:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388100.119931:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925697536 00000100:00100000:0.0:1787388100.119941:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925697536 00010000:00010000:0.0:1787388100.119996:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e18 expref: 45 pid: 6520 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388100.120035:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:0.0:1787388100.120045:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+45:2401:x1874211925697536:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388100.120089:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388100.120097:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e18 expref: 45 pid: 6520 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.120110:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e18 expref: 45 pid: 6520 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.120132:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44748f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e18 expref: 45 pid: 6520 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.121056:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:0.0:1787388100.121062:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.121073:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.121080:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.121241:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388100.121304:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+44:2401:x1874211925697536:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 1258us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388100.121313:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00010000:00010000:1.0:1787388100.124585:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.124602:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388100.124661:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787388100.124665:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388100.124706:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.124722:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.124732:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.124739:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474920 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.130811:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474920 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.130819:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388100.130824:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474920 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.130834:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474920 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.130938:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:1.0:1787388100.130941:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388100.130946:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474920 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.130954:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474920 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.130981:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.130988:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474927 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.130994:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.130999:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388100.131002:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.131020:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474927 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.131030:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b43bd1100) 00010000:00010000:1.0:1787388100.131032:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388100.131034:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474927 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.131040:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474927 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.131449:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474919 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e26 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.131468:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e26 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.131476:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388100.131478:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388100.131481:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ee00, rc 0) 00000100:00100000:1.0:1787388100.131743:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+43:11247:x1874211925697152:12345-192.168.203.15@tcp:101:stat.0 Request processed in 23852us (24243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388100.131750:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00010000:00010000:1.0:1787388100.204886:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388100.248497:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388100.248697:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925697792 00000100:00100000:3.0:1787388100.248707:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925697792 00000100:00100000:3.0:1787388100.248777:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:3.0:1787388100.248787:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+43:11253:x1874211925697792:12345-192.168.203.15@tcp:36:truncate.0 00010000:00010000:3.0:1787388100.248842:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388100.248867:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a447492e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e26 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.248885:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:3.0:1787388100.248889:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388100.249078:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.249092:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.249102:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388100.250449:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1787388100.250495:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006509fa58 reply state 00000000c92df856 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.250513:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.250521:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:3.0:1787388100.250524:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388100.250527:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388100.250710:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+45:11253:x1874211925697792:12345-192.168.203.15@tcp:36:truncate.0 Request processed in 1921us (2218us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787388100.250718:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000020:00080000:3.0:1787388100.250723:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787388100.497578:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388100.497740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925697920 00000100:00100000:2.0:1787388100.497749:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925697920 00000100:00100000:2.0:1787388100.497809:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:2.0:1787388100.497819:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+45:11267:x1874211925697920:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:2.0:1787388100.497843:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388100.497864:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447493c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e2d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.497928:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5da00/0x26817551a4474943 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.497943:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5da00/0x26817551a4474943 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.497967:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5da00/0x26817551a4474943 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.497980:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447494a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.497986:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447494a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.497993:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447494a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498089:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498111:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498119:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388100.498173:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787388100.498177:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388100.498199:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498210:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498219:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5da00/0x26817551a4474943 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498225:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5da00/0x26817551a4474943 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498231:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5da00/0x26817551a4474943 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498237:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5da00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388100.498241:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5da00/0x26817551a4474943 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498248:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5da00/0x26817551a4474943 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498260:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388100.498269:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388100.498273:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5da00/0x26817551a4474943 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498279:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5da00/0x26817551a4474943 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498294:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447494a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498300:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447494a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498306:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447494a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498312:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388100.498314:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447494a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498321:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447494a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498329:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b43bd1100) 00010000:00010000:2.0:1787388100.498331:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388100.498334:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447494a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498340:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447494a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498420:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a447493c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e2d expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498447:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e2d expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.498455:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:2.0:1787388100.498457:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388100.498460:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d400, rc 0) 00000100:00100000:2.0:1787388100.498807:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+46:11267:x1874211925697920:12345-192.168.203.15@tcp:101:stat.0 Request processed in 988us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388100.498816:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:2.0:1787388100.626635:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388100.626724:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925698176 00000100:00100000:1.0:1787388100.626733:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925698176 00000100:00100000:1.0:1787388100.626799:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:1.0:1787388100.626811:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+46:11277:x1874211925698176:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388100.626845:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388100.626865:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474958 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388100.627000:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787388100.627096:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474958 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e34 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.627111:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:1.0:1787388100.627114:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388100.627119:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e34 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.627133:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e400, rc 0) 00000100:00100000:1.0:1787388100.627189:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+47:11277:x1874211925698176:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 379us (562us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1787388100.627196:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:3.0:1787388100.639903:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388100.639980:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925698432 00000100:00100000:2.0:1787388100.639990:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925698432 00000100:00100000:2.0:1787388100.640051:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:2.0:1787388100.640063:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+47:11277:x1874211925698432:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388100.640313:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+48:11277:x1874211925698432:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 250us (558us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1787388100.640321:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:3.0:1787388100.735853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388100.736037:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925698688 00000100:00100000:2.0:1787388100.736047:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925698688 00000100:00100000:2.0:1787388100.736109:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:2.0:1787388100.736119:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+48:11283:x1874211925698688:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388100.736153:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388100.736173:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474966 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e3b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.736305:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.736320:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e2d expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.736329:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.736400:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e2d expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.736414:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e2d expref: 49 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388100.736428:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945715456:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388100.736720:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787388100.741261:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945715456:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388100.741295:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388100.742678:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388100.743293:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925698816 00000100:00100000:1.0:1787388100.743304:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925698816 00010000:00010000:1.0:1787388100.743371:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e2d expref: 50 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388100.743413:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:1.0:1787388100.743423:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+50:2402:x1874211925698816:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388100.743436:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388100.743442:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e2d expref: 50 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.743474:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e2d expref: 50 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.743497:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474951 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e2d expref: 50 pid: 6521 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.743514:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388100.743518:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.743527:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.743545:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.743578:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388100.743636:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+49:2402:x1874211925698816:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 214us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388100.743644:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00010000:00010000:3.0:1787388100.744030:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.744039:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388100.744056:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787388100.744199:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474966 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e3b expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.744229:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e3b expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.744237:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:3.0:1787388100.744240:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787388100.744242:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c200, rc 0) 00000100:00100000:3.0:1787388100.744273:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+49:11283:x1874211925698688:12345-192.168.203.15@tcp:101:bash.0 Request processed in 8155us (8428us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787388100.744280:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:3.0:1787388100.754665:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388100.754922:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925699072 00000100:00100000:2.0:1787388100.754934:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925699072 00000100:00100000:2.0:1787388100.755004:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:2.0:1787388100.755015:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+49:11283:x1874211925699072:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:2.0:1787388100.755248:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.755265:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.755276:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787388100.755329:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1787388100.755382:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ac4efb6 reply state 00000000ed06d0c2 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.755395:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.755402:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:2.0:1787388100.755405:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388100.755409:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388100.755504:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+52:11283:x1874211925699072:12345-192.168.203.15@tcp:36:bash.0 Request processed in 491us (846us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1787388100.755512:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00000020:00080000:2.0:1787388100.755517:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787388100.762818:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388100.762967:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925699200 00000100:00100000:0.0:1787388100.762988:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925699200 00000100:00100000:0.0:1787388100.763053:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:0.0:1787388100.763063:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+52:11283:x1874211925699200:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1787388100.763088:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388100.763107:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474982 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e42 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.763225:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.763239:0:13515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e3b expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.763247:0:13515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.763280:0:13515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e3b expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.763294:0:13515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e3b expref: 53 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388100.763308:0:13515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a44049c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945715584:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388100.763425:0:13515:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b729819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388100.767511:0:13515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a44049c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945715584:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388100.767553:0:13515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388100.769058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388100.769405:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925699328 00000100:00100000:3.0:1787388100.769415:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925699328 00010000:00010000:3.0:1787388100.769456:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e3b expref: 54 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388100.769500:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:3.0:1787388100.769509:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+54:2402:x1874211925699328:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388100.769523:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388100.769529:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e3b expref: 54 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.769624:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e3b expref: 54 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.769646:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447496d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e3b expref: 54 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.769685:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:3.0:1787388100.769691:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.769700:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.769708:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.769744:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388100.769926:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+53:2402:x1874211925699328:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 417us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388100.769935:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00010000:00010000:2.0:1787388100.770012:0:13515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.770020:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388100.770071:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787388100.770076:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388100.770094:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.770123:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474982 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e42 expref: 53 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.770175:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e42 expref: 52 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.770183:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:2.0:1787388100.770185:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388100.770187:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030c00, rc 0) 00000100:00100000:2.0:1787388100.770215:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+52:11283:x1874211925699200:12345-192.168.203.15@tcp:101:bash.0 Request processed in 7154us (7406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388100.770223:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:2.0:1787388100.778012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388100.778098:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925699584 00000100:00100000:3.0:1787388100.778108:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925699584 00000100:00100000:3.0:1787388100.778402:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:3.0:1787388100.778413:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dccf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+52:11283:x1874211925699584:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:3.0:1787388100.778759:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dccf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+53:11283:x1874211925699584:12345-192.168.203.15@tcp:35:bash.0 Request processed in 347us (756us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787388100.778767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1787388100.844690:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945715712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388100.844802:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388100.844983:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388100.844995:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945715840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388100.845024:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388100.845099:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945715712 00000100:00100000:1.0:1787388100.845108:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945715712 00000100:00100000:1.0:1787388100.845161:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945715840 00000100:00100000:1.0:1787388100.845165:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945715840 00000100:00100000:1.0:1787388100.845184:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787388100.845193:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945715712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388100.845220:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388100.845262:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945715712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388100.845276:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787388100.845294:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787388100.845300:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945715840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388100.845310:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388100.845339:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945715840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388100.845371:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787388100.845416:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945715840:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787388100.845482:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388100.845709:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945715712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388100.908665:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388100.908805:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925699840 00000100:00100000:3.0:1787388100.908816:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925699840 00000100:00100000:3.0:1787388100.908896:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:3.0:1787388100.908906:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+53:11293:x1874211925699840:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388100.908930:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388100.908950:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474990 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e49 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388100.909057:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787388100.909203:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474990 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e49 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.909218:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:3.0:1787388100.909220:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388100.909225:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474990 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e49 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388100.909238:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6600, rc 0) 00000100:00100000:3.0:1787388100.909300:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+54:11293:x1874211925699840:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 395us (643us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1787388100.909308:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:2.0:1787388100.916755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388100.916902:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925699968 00000100:00100000:0.0:1787388100.916912:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925699968 00000100:00100000:0.0:1787388100.916980:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:0.0:1787388100.916990:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+54:11293:x1874211925699968:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:0.0:1787388100.917061:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447499e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917076:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447499e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917088:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447499e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917099:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44749a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917105:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44749a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917112:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44749a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917205:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917215:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917221:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388100.917282:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917296:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447499e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917302:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447499e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917308:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447499e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917315:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388100.917319:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447499e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917326:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447499e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917338:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:0.0:1787388100.917341:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388100.917381:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447499e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917387:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447499e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917398:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44749a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917403:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44749a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917416:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44749a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917421:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388100.917424:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44749a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917429:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44749a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917436:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b43bd1100) 00010000:00010000:0.0:1787388100.917438:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388100.917440:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44749a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917445:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44749a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917453:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917459:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917464:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917468:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388100.917470:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917484:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917491:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:0.0:1787388100.917492:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388100.917495:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.917500:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44749ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388100.917577:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+54:11293:x1874211925699968:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 588us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388100.917585:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:2.0:1787388100.921061:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388100.921192:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925700224 00000100:00100000:0.0:1787388100.921201:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925700224 00000100:00100000:0.0:1787388100.921257:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:0.0:1787388100.921267:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+54:11293:x1874211925700224:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1787388100.921673:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+55:11293:x1874211925700224:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 405us (619us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787388100.921681:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000001:00080000:1.0:1787388100.925034:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000004:00080000:1.0:1787388100.925083:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787388100.925105:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996b72bc9000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787388100.925110:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b4391f200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996b72bc9180 00000020:00080000:1.0:1787388100.925113:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b4391fd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996b49993c00 00000100:00100000:0.0:1787388100.925337:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388100.925376:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945715968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787388100.925437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388100.925504:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945715968 00000100:00100000:0.0:1787388100.925511:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945715968 00000100:00100000:0.0:1787388100.925558:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787388100.925567:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1874211945715968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787388100.925601:0:8490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1787388100.925633:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8960c3, atime: 0x6a8960c3, ctime: 0x6a8960c3, blocks: 0x8 00010000:00010000:0.0:1787388100.925641:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a44749b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.925657:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1787388100.925661:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388100.925667:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a44749b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.925683:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a44749b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.925693:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a44749b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.925701:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a44749b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.925719:0:8490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787388100.925876:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1874211945715968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 310us (438us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787388100.925884:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787388100.925903:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388100.925909:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a44749b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.925930:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388100.925935:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a44749b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.925944:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a44749b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.925969:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a44749b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.925977:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a44749b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388100.925997:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388100.925998:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388100.926000:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787388100.926030:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996a4404bb80/2, rc 0, transno 4294967302 00000100:00100000:0.0:1787388100.926036:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945715968:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1787388100.930430:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787388100.930631:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:3.0:1787388100.930647:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787388100.936319:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936338:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936610:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936618:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388100.936623:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936632:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936673:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff996b43bd1700) 00010000:00010000:2.0:1787388100.936676:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388100.936682:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936688:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a44747c2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936711:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936718:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936724:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936859:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388100.936864:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936871:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936880:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388100.936882:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388100.936885:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936891:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a44747c9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936919:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936925:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936930:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936935:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388100.936938:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936945:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936961:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b43bd1100) 00010000:00010000:2.0:1787388100.936964:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388100.936967:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936973:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474808 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936987:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936993:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.936998:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937009:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388100.937013:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937020:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937029:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:2.0:1787388100.937031:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388100.937034:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937040:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474912 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937052:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937058:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937063:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937068:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388100.937070:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937077:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937095:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:2.0:1787388100.937097:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388100.937100:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937105:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474935 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937114:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937119:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937878:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937890:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5dc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388100.937894:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937901:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937912:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:2.0:1787388100.937915:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388100.937918:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.937924:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447497b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388100.980519:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388100.980616:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925700480 00000100:00100000:2.0:1787388100.980626:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925700480 00000100:00100000:2.0:1787388100.980689:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:2.0:1787388100.980699:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+12:11296:x1874211925700480:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388100.980723:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388100.980754:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44749ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e50 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.980826:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44749c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.980840:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44749c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.980850:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44749c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.980865:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a44749c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.980871:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a44749c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.980877:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a44749c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.980993:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44749cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981002:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44749cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981022:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44749cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388100.981032:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787388100.981112:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44749c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981119:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44749c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981139:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44749c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981146:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388100.981150:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44749c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981157:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44749c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981412:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388100.981415:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388100.981420:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44749c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981425:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44749c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981440:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a44749c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981446:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a44749c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981457:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a44749c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981463:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388100.981466:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a44749c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981472:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a44749c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981481:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b43bd1100) 00010000:00010000:2.0:1787388100.981483:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388100.981486:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a44749c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981491:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a44749c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981535:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44749ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e50 expref: 15 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981549:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44749cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e50 expref: 14 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388100.981556:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:2.0:1787388100.981559:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388100.981561:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d600, rc 0) 00000100:00100000:2.0:1787388100.981620:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+14:11296:x1874211925700480:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 922us (1111us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787388100.981636:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:2.0:1787388100.986116:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388100.986377:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925700608 00000100:00100000:1.0:1787388100.986387:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925700608 00000100:00100000:1.0:1787388100.986441:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:1.0:1787388100.986450:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+14:11296:x1874211925700608:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:1.0:1787388100.986512:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.986526:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.986537:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.986590:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.986598:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.986605:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.986615:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388100.986619:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.986627:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.986639:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388100.986643:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388100.986647:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.986653:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388100.986719:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+14:11296:x1874211925700608:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 269us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388100.986727:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:0.0:1787388100.990778:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388100.990851:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925700736 00000100:00100000:1.0:1787388100.990859:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925700736 00000100:00100000:1.0:1787388100.990923:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:1.0:1787388100.990948:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+14:2402:x1874211925700736:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388100.990973:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388100.990999:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44749cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e50 expref: 14 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388100.991020:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388100.991024:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388100.991080:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+13:2402:x1874211925700736:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 133us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388100.991088:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:3.0:1787388100.994297:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388100.994466:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925700992 00000100:00100000:2.0:1787388100.994476:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925700992 00000100:00100000:2.0:1787388100.994521:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:2.0:1787388100.994531:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+13:11296:x1874211925700992:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388100.994755:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+14:11296:x1874211925700992:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 224us (466us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787388100.994764:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:2.0:1787388101.210024:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388101.210122:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925701248 00000100:00100000:1.0:1787388101.210131:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925701248 00000100:00100000:1.0:1787388101.210197:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 74 00000100:00100000:1.0:1787388101.210207:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+14:11314:x1874211925701248:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:1.0:1787388101.210230:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388101.210251:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e57 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.210715:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44749eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.210826:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44749eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.210840:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44749eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388101.210852:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787388101.210983:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44749e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e57 expref: 17 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.211002:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44749eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e57 expref: 16 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.211011:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388101.211015:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787388101.211018:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ec00, rc 0) 00000100:00100000:1.0:1787388101.211082:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+16:11314:x1874211925701248:12345-192.168.203.15@tcp:101:cat.0 Request processed in 876us (1067us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1787388101.211090:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 74 00010000:00010000:1.0:1787388101.230070:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388101.270227:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388101.270318:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925701376 00000100:00100000:3.0:1787388101.270329:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925701376 00000100:00100000:3.0:1787388101.270414:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00100000:3.0:1787388101.270425:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+16:11315:x1874211925701376:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388101.270465:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388101.270487:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44749f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e5e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.270550:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474a00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.270563:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474a00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.270573:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474a00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388101.270614:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787388101.270618:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388101.270634:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474a00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.270659:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44749f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e5e expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.270677:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474a00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e5e expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.270685:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:3.0:1787388101.270688:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388101.270691:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7e00, rc 0) 00000100:00100000:3.0:1787388101.270760:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+17:11315:x1874211925701376:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 336us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388101.270767:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00100000:3.0:1787388101.278970:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388101.279081:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925701760 00000100:00100000:2.0:1787388101.279092:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925701760 00000100:00100000:2.0:1787388101.279161:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1787388101.279171:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+17:11315:x1874211925701760:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388101.279702:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+18:11315:x1874211925701760:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 530us (746us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787388101.279711:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1787388101.287719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388101.287876:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925701888 00000100:00100000:3.0:1787388101.287886:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925701888 00000100:00100000:3.0:1787388101.287960:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:3.0:1787388101.287970:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:11315:x1874211925701888:12345-192.168.203.15@tcp:103:lfs.0 00010000:00010000:3.0:1787388101.287985:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787388101.288011:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474989 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e42 expref: 18 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.288034:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44749eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e57 expref: 17 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.288045:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474886 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dfc expref: 16 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.288067:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:3.0:1787388101.288072:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388101.288248:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:11315:x1874211925701888:12345-192.168.203.15@tcp:103:lfs.0 Request processed in 278us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388101.288256:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:1.0:1787388101.291440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388101.291534:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925702016 00000100:00100000:2.0:1787388101.291543:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925702016 00000100:00100000:2.0:1787388101.291604:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:2.0:1787388101.291614:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:11315:x1874211925702016:12345-192.168.203.15@tcp:58:lfs.0 00010000:00010000:2.0:1787388101.291864:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474a07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.291879:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474a07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.291898:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474a07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388101.292533:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787388101.292667:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787388101.292989:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787388101.293442:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:11315:x1874211925702016:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 1825us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388101.293452:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:1.0:1787388101.324491:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388101.324586:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925702144 00000100:00100000:0.0:1787388101.324596:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925702144 00000100:00100000:0.0:1787388101.324655:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:0.0:1787388101.324665:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+15:11317:x1874211925702144:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388101.324686:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388101.324704:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e65 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.324791:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.324804:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.324812:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.324822:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.324827:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.324831:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.324896:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.324902:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.324906:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388101.324936:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787388101.324947:0:10197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388101.324977:0:10197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325004:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325012:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325019:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325026:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325032:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388101.325036:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325042:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325062:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:0.0:1787388101.325066:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388101.325070:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325076:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325089:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325095:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325107:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325112:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388101.325115:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325121:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325129:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b74d22600) 00010000:00010000:0.0:1787388101.325131:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388101.325134:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325140:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325171:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e65 expref: 17 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325185:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e65 expref: 16 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.325192:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:0.0:1787388101.325195:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388101.325198:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030c00, rc 0) 00000100:00100000:0.0:1787388101.325259:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+16:11317:x1874211925702144:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 596us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388101.325276:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 77 00000040:00080000:0.0:1787388101.740581:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787388101.740591:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787388101.740636:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787388101.740643:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787388101.740803:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a44049880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945716096:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787388101.740909:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b729819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388101.747617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388101.747756:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a44049880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945716096:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787388101.751537:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925702272 00000100:00100000:2.0:1787388101.751549:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925702272 00000100:00100000:3.0:1787388101.752061:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:3.0:1787388101.752072:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+16:11328:x1874211925702272:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787388101.752102:0:6520:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787388101.752242:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+16:11328:x1874211925702272:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 171us (4632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388101.752250:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:3.0:1787388101.759040:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388101.759137:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925702400 00000100:00100000:0.0:1787388101.759147:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925702400 00000100:00100000:0.0:1787388101.759221:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:0.0:1787388101.759231:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+16:11328:x1874211925702400:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787388101.759308:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474a2a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759325:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474a2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759338:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474a2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759425:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474a31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759433:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474a31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759440:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474a31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759477:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759485:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759491:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388101.759535:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787388101.759540:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388101.759553:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759564:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474a2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759570:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474a2a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759577:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474a2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759584:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388101.759588:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474a2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759595:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474a2a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759606:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:0.0:1787388101.759615:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388101.759620:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474a2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759638:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474a2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759651:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474a31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759657:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474a31 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759662:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474a31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759666:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388101.759668:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474a31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759673:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474a31 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759681:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff996b74d22600) 00010000:00010000:0.0:1787388101.759683:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388101.759686:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474a31 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759691:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474a31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759704:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759717:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759722:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759727:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388101.759730:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759736:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759744:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:0.0:1787388101.759746:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388101.759749:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.759754:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474a38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388101.761367:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+16:11328:x1874211925702400:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 2112us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388101.761382:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:3.0:1787388101.767410:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388101.767588:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925702656 00000100:00100000:0.0:1787388101.767600:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925702656 00000100:00100000:0.0:1787388101.767666:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00100000:0.0:1787388101.767677:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+16:11328:x1874211925702656:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388101.767700:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388101.768270:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a3f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e6c expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.768416:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.768431:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.768443:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388101.768455:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787388101.768532:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.768540:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.768546:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.768550:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388101.768554:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.768560:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.768571:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:0.0:1787388101.768573:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388101.768577:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.768591:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474a46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.772830:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a3f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e6c expref: 18 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.772856:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:0.0:1787388101.772859:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388101.772865:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474a3f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e6c expref: 18 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.772882:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030000, rc 0) 00000100:00100000:0.0:1787388101.772960:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+17:11328:x1874211925702656:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 5276us (5550us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1787388101.772969:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00100000:1.0:1787388101.777400:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388101.777485:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925702784 00000100:00100000:2.0:1787388101.777494:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925702784 00000100:00100000:2.0:1787388101.777545:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 81 00000100:00100000:2.0:1787388101.777553:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+17:11328:x1874211925702784:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787388101.777584:0:13515:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787388101.777703:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+17:11328:x1874211925702784:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 150us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388101.777711:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 81 00000100:00100000:3.0:1787388101.784506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388101.784633:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925703040 00000100:00100000:2.0:1787388101.784642:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925703040 00000100:00100000:2.0:1787388101.784693:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 82 00000100:00100000:2.0:1787388101.784703:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+17:11328:x1874211925703040:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388101.784723:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388101.784736:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787388101.784762:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474a00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e5e expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.784963:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388101.784969:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388101.784984:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474a54 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e73 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388101.785485:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787388101.787128:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474a5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.787149:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474a5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.787172:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474a5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.787270:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474a54 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e73 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.787291:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474a5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e73 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.787299:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b43bd1100) 00010000:00010000:3.0:1787388101.787301:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388101.787304:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5dc00, rc 0) 00000100:00100000:3.0:1787388101.787425:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:11328:x1874211925703040:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 2723us (2927us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787388101.787433:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 82 00000100:00100000:1.0:1787388101.793841:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388101.793981:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925703296 00000100:00100000:2.0:1787388101.793990:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925703296 00000100:00100000:2.0:1787388101.794048:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 83 00000100:00100000:2.0:1787388101.794058:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+18:11328:x1874211925703296:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388101.794116:0:10197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388101.794157:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474a5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e73 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794184:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b43bd1100) 00010000:00010000:2.0:1787388101.794194:0:10197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388101.794217:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474a69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794229:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474a69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794238:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474a69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794299:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474a70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x7fbbb59a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794325:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474a70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7fbbb59a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794332:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474a70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7fbbb59a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794461:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474a69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794468:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474a69 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794475:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474a69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794480:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388101.794484:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474a69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794491:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474a69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794499:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388101.794501:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388101.794505:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474a69 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794510:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474a69 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794521:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474a70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7fbbb59a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794532:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474a70 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7fbbb59a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794538:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474a70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7fbbb59a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794541:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388101.794544:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474a70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7fbbb59a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794550:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474a70 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7fbbb59a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794557:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x7fbbb59a (ffff996b43bd1700) 00010000:00010000:2.0:1787388101.794560:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388101.794562:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474a70 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7fbbb59a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.794568:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474a70 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7fbbb59a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388101.794643:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+17:11328:x1874211925703296:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 586us (811us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787388101.794650:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 83 00000100:00100000:0.0:1787388101.798411:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388101.798473:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925703424 00000100:00100000:1.0:1787388101.798481:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925703424 00000100:00100000:1.0:1787388101.798537:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 84 00000100:00100000:1.0:1787388101.798546:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+17:11328:x1874211925703424:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388101.798565:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388101.798586:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4474a77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e7a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.798619:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.798644:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.798654:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.798759:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4474a77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e7a expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.798786:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e7a expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.798795:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:1.0:1787388101.798798:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388101.798801:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f000, rc 0) 00000100:00100000:1.0:1787388101.798849:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+18:11328:x1874211925703424:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 305us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388101.798856:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 84 00000100:00100000:1.0:1787388101.804667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388101.805318:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925703680 00000100:00100000:3.0:1787388101.805329:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925703680 00000100:00100000:3.0:1787388101.805552:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 85 00000100:00100000:3.0:1787388101.805563:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:11328:x1874211925703680:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787388101.805645:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.805675:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.805686:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787388101.805998:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787388101.806008:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423328660121ns, next at 424328658156ns, rc = 0 00000004:00010000:3.0:1787388101.806060:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000497fbe12 reply state 00000000c862345c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.806074:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.806081:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:3.0:1787388101.806084:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787388101.806087:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388101.806249:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+20:11328:x1874211925703680:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 687us (1589us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787388101.806256:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 85 00000100:00100000:2.0:1787388101.808682:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388101.808794:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925703808 00000100:00100000:3.0:1787388101.808803:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925703808 00000100:00100000:3.0:1787388101.808855:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 86 00000100:00100000:3.0:1787388101.808864:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+20:11328:x1874211925703808:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388101.808884:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388101.808902:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474a8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e81 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.808984:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474a8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e81 expref: 21 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.808997:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474a8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e81 expref: 21 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.809015:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:3.0:1787388101.809019:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388101.809022:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6800, rc 0) 00000100:00100000:3.0:1787388101.809085:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+21:11328:x1874211925703808:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 221us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388101.809092:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 86 00000100:00100000:0.0:1787388101.812271:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388101.812391:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925703936 00000100:00100000:2.0:1787388101.812401:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925703936 00000100:00100000:2.0:1787388101.812447:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:2.0:1787388101.812455:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874211925703936:12345-192.168.203.15@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787388101.812502:0:8434:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:2.0:1787388101.812533:0:8434:0:(genops.c:1406:class_connect()) connect: client 00e97fed-41ea-4716-be07-f037d23906cf, cookie 0x26817551a4474a93 00002000:00100000:2.0:1787388101.812545:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 00e97fed-41ea-4716-be07-f037d23906cf/ffff996a43206800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787388101.812555:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787388101.812630:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787388101.812659:0:8434:0:(import.c:65:import_set_state_nolock()) ffff996a43200800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388101.812739:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2398:x1874211925703936:12345-192.168.203.15@tcp:8:lhsmtool_posix.0 Request processed in 283us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388101.812746:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:0.0:1787388101.815605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388101.815696:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925704064 00000100:00100000:2.0:1787388101.815707:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925704064 00000100:00100000:0.0:1787388101.815864:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:0.0:1787388101.815876:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:0:x1874211925704064:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787388101.816313:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787388101.834464:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1787388101.834477:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000100:00100000:1.0:1787388101.835097:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:0:x1874211925704064:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 19210us (19485us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787388101.835109:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:3.0:1787388101.853960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388101.854070:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925704320 00000100:00100000:0.0:1787388101.854079:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925704320 00000100:00100000:0.0:1787388101.854149:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:0.0:1787388101.854159:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+21:11328:x1874211925704320:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787388101.854415:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+22:11328:x1874211925704320:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 257us (473us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1787388101.854435:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:2.0:1787388101.867736:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388101.869372:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925704576 00000100:00100000:0.0:1787388101.869388:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925704576 00000100:00100000:0.0:1787388101.869449:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 87 00000100:00100000:0.0:1787388101.869459:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+22:11328:x1874211925704576:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787388101.869573:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+22:11328:x1874211925704576:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 115us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388101.869581:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 87 00000100:00100000:0.0:1787388101.873426:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388101.873500:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925704704 00000100:00100000:3.0:1787388101.873509:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925704704 00000100:00100000:3.0:1787388101.873567:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 88 00000100:00100000:3.0:1787388101.873578:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+22:11328:x1874211925704704:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388101.873597:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388101.873617:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474a9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e88 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.873685:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474aa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.873699:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.873722:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388101.873928:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388101.873956:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.873987:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474a9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e88 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.874005:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e88 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388101.874013:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:3.0:1787388101.874016:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787388101.874020:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6a00, rc 0) 00000100:00100000:3.0:1787388101.874081:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+23:11328:x1874211925704704:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 504us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388101.874088:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 88 00000100:00100000:0.0:1787388101.878997:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388101.879089:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925704832 00000100:00100000:2.0:1787388101.879099:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925704832 00000100:00100000:2.0:1787388101.879165:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:2.0:1787388101.879176:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925704832:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388101.879192:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388101.879211:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4474aa8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e8f expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787388101.879233:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8960c6, blocks: 0x0 00010000:00010000:2.0:1787388101.879250:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=423s v=(0 0) 00010000:00010000:2.0:1787388101.879254:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388101.879263:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4474aa8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e8f expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.879294:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4474aa8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e8f expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388101.879307:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5dc00, rc 0) 00000100:00100000:2.0:1787388101.879383:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925704832:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 209us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388101.879390:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:1.0:1787388101.897426:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388101.897624:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925705088 00000100:00100000:3.0:1787388101.897634:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925705088 00000100:00100000:3.0:1787388101.897726:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 89 00000100:00100000:3.0:1787388101.897737:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+23:11328:x1874211925705088:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787388101.897858:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+23:11328:x1874211925705088:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 124us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388101.897866:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 89 00000100:00100000:0.0:1787388101.901631:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388101.901711:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925705216 00000100:00100000:1.0:1787388101.901721:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925705216 00000100:00100000:1.0:1787388101.901787:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:1.0:1787388101.901798:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:11328:x1874211925705216:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388101.901830:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388101.901851:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e96 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.901883:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4474aa8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e8f expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.901892:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388101.901896:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388101.901902:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 7 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.902264:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4474aa8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e8f expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.902278:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4474aa8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e8f expref: 7 pid: 8434 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388101.902292:0:8490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43920000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874211945716224:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388101.902407:0:8490:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388101.915528:0:8490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43920000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874211945716224:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388101.915541:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00010000:00010000:1.0:1787388101.915567:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 7 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.915588:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fc00, rc 0) 00000100:00100000:1.0:1787388101.915656:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+7:11328:x1874211925705216:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 13860us (14034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388101.915666:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:0.0:1787388101.916035:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925705344 00000100:00100000:0.0:1787388101.916042:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925705344 00010000:00010000:0.0:1787388101.916072:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4474aa8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e8f expref: 7 pid: 8434 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388101.916870:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:0.0:1787388101.916882:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925705344:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388101.916895:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388101.916931:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4474aa8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e8f expref: 7 pid: 8434 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.916955:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4474aa8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e8f expref: 7 pid: 8434 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.916994:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4474aa8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e8f expref: 7 pid: 8434 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.917007:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388101.917012:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388101.917019:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 6 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.917028:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 6 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388101.917064:0:7462:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 6 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388101.917079:0:7462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7462:1874211945716352:192.168.203.15@tcp:105: 00000100:00100000:0.0:1787388101.917417:0:7462:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b50a29540 going to sleep for 11 seconds 00000100:00100000:2.0:1787388101.934045:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388101.934370:0:7462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7462:1874211945716352:192.168.203.15@tcp:105: 00010000:00010000:3.0:1787388101.934411:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388101.934462:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925705344:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 17582us (18923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388101.934473:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:1.0:1787388101.939653:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925705472 00000100:00100000:1.0:1787388101.939667:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925705472 00002000:00100000:1.0:1787388101.939718:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff996b7f5e9180 x1874211925705472/t0(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:357/0 lens 504/0 e 0 to 0 dl 1787388112 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388101.939730:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b7f5e9180 with x1874211925705472 ext(0->8) 00002000:00010000:1.0:1787388101.939735:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b7f5e9180 00000100:00100000:1.0:1787388101.939779:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:1.0:1787388101.939788:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925705472:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787388101.941147:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925705472:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 Request processed in 1353us (7106us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787388101.941158:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00002000:00100000:1.0:1787388101.941166:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff996b7f5e9180 x1874211925705472/t4294967303(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:357/0 lens 504/448 e 0 to 0 dl 1787388112 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388101.941177:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b7f5e9180 with x1874211925705472 ext(0->8) 00002000:00010000:1.0:1787388101.941182:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b7f5e9180 00000100:00100000:3.0:1787388101.950636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388101.950668:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925705600 00000100:00100000:3.0:1787388101.950677:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925705600 00000100:00100000:3.0:1787388101.950733:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 90 00000100:00100000:3.0:1787388101.950742:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+23:11328:x1874211925705600:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787388101.959494:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1787388101.959509:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787388101.959536:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:1.0:1787388101.959581:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.959593:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.959600:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.959615:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388101.959620:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.959628:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.959644:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:1.0:1787388101.959647:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787388101.959652:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.959658:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474a85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787388101.959780:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787388101.959791:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787388101.959800:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945716480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787388101.959864:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388101.959905:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+14:11328:x1874211925705600:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 9161us (9274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388101.959916:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 90 00000100:00100000:0.0:1787388101.961112:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945716480 00000100:00100000:0.0:1787388101.961123:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945716480 00000100:00100000:0.0:1787388101.961179:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787388101.961189:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945716480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787388101.961310:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787388101.961314:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787388102 00002000:00010000:0.0:1787388101.961316:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787388101.961323:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787388102 -> 1787388102 00002000:00010000:0.0:1787388101.961326:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787388101.961407:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945716480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (1541us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787388101.961414:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1787388101.961437:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996b7f683480/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787388101.961445:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945716480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787388101.965366:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388101.965483:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925705728 00000100:00100000:0.0:1787388101.965492:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925705728 00000100:00100000:0.0:1787388101.965540:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:0.0:1787388101.965549:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925705728:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787388101.966721:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1787388101.966732:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1787388101.966925:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925705728:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 1373us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388101.966935:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:3.0:1787388101.971220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388101.971304:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925705984 00000100:00100000:1.0:1787388101.971314:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925705984 00000100:00100000:1.0:1787388101.971392:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 91 00000100:00100000:1.0:1787388101.971402:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+14:11328:x1874211925705984:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787388101.971454:0:13515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388101.971481:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474aa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e88 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.971499:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:1.0:1787388101.971504:0:13515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388101.971532:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.971545:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.971562:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388101.971676:0:13515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f4eb399 reply state 00000000a4208e24 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.971690:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.971696:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:1.0:1787388101.971699:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388101.971701:0:13515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388101.971809:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+15:11328:x1874211925705984:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 407us (598us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1787388101.980932:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 91 00000100:00100000:2.0:1787388101.986760:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388101.986798:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925706112 00000100:00100000:2.0:1787388101.986807:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925706112 00000100:00100000:2.0:1787388101.986857:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:2.0:1787388101.986867:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925706112:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787388101.987049:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787388101.987053:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787388102 -> 1787388101 00002000:00010000:2.0:1787388101.987056:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787388099 00002000:00010000:2.0:1787388101.987071:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787388102 -> 1787388101 00002000:00010000:2.0:1787388101.987073:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787388101.987128:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925706112:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 262us (388us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787388101.987136:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:3.0:1787388101.993775:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388101.993837:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925706368 00000100:00100000:1.0:1787388101.993847:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925706368 00000100:00100000:1.0:1787388101.993905:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 92 00000100:00100000:1.0:1787388101.993915:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+15:11328:x1874211925706368:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787388101.993990:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.994007:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e7a expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.994017:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.994054:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e7a expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388101.994075:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e7a expref: 15 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388101.994091:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43920000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945716608:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388101.994183:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787388102.000668:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43920000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945716608:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388102.000699:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388102.002148:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388102.004381:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925706496 00000100:00100000:0.0:1787388102.004393:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925706496 00010000:00010000:0.0:1787388102.004446:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e7a expref: 16 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388102.004483:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:0.0:1787388102.004493:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+16:2401:x1874211925706496:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388102.004507:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388102.004514:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e7a expref: 16 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004526:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e7a expref: 16 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004560:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474a7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e7a expref: 16 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004572:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:0.0:1787388102.004577:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004585:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004592:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004618:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388102.004671:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:2401:x1874211925706496:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 179us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388102.004679:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00010000:00010000:0.0:1787388102.004711:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004718:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004767:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004775:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004782:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004794:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388102.004798:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004805:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004815:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:0.0:1787388102.004818:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787388102.004821:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.004827:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474abd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388102.004865:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+14:11328:x1874211925706368:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 Request processed in 10951us (11099us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787388102.004873:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 92 00000100:00080000:3.0:1787388102.008479:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388102.010934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388102.010998:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925706624 00000100:00100000:0.0:1787388102.011008:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925706624 00000100:00100000:0.0:1787388102.011069:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:0.0:1787388102.011080:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925706624:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787388102.011138:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.011160:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 7 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.011182:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388102.011186:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388102.011191:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.011226:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 7 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.011239:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 7 pid: 8490 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388102.011253:0:8490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874211945716736:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388102.011334:0:8490:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72bc9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787388102.017142:0:8490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874211945716736:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388102.017171:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388102.026553:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388102.026590:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925706752 00000100:00100000:2.0:1787388102.026599:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925706752 00010000:00010000:2.0:1787388102.026635:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 8 pid: 8490 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388102.026670:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1787388102.026679:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925706752:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388102.026691:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388102.026713:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 8 pid: 8490 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.026737:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 8 pid: 8490 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.026761:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4474aaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e96 expref: 8 pid: 8490 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.027865:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388102.027870:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388102.027875:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.027895:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.027929:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388102.027995:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925706752:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 1314us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388102.028003:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00010000:00010000:0.0:1787388102.028264:0:8490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.028275:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.028299:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.028314:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.028323:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.028329:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388102.028334:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.028342:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.028371:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.028379:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474ac4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388102.028428:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925706624:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 17350us (17502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388102.028436:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:3.0:1787388102.034311:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388102.034424:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925707008 00000100:00100000:0.0:1787388102.034434:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925707008 00000100:00100000:0.0:1787388102.034492:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 93 00000100:00100000:0.0:1787388102.034512:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+14:11328:x1874211925707008:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787388102.034590:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.034606:0:10197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e1f expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.034616:0:10197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.034650:0:10197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e1f expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.034664:0:10197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e1f expref: 14 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388102.034680:0:10197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945716864:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388102.034774:0:10197:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72bc9000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388102.038378:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388102.038472:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925707136 00000100:00100000:1.0:1787388102.038481:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925707136 00010000:00010000:1.0:1787388102.038516:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e1f expref: 15 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388102.038546:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:1.0:1787388102.038555:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:2401:x1874211925707136:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388102.038568:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388102.038574:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e1f expref: 15 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.038585:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e1f expref: 15 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.038607:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388102.038612:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.038634:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.038640:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.038660:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388102.038704:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:2401:x1874211925707136:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 149us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388102.038711:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00010000:00010000:0.0:1787388102.039056:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a447490b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e1f expref: 14 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388102.039075:0:10197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945716864:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388102.039094:0:10197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.039103:0:10197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.039133:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.039296:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.039308:0:10197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474a8c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e81 expref: 14 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.039316:0:10197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.039369:0:10197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474a8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e81 expref: 14 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.039383:0:10197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474a8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e81 expref: 14 pid: 13515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388102.039397:0:10197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945716992:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388102.039444:0:10197:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517e8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787388102.049599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388102.049629:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925707264 00000100:00100000:1.0:1787388102.049637:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925707264 00010000:00010000:1.0:1787388102.049673:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474a8c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e81 expref: 15 pid: 13515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388102.049706:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:1.0:1787388102.049715:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+15:2402:x1874211925707264:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388102.049742:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388102.049749:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474a8c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e81 expref: 15 pid: 13515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.049770:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474a8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e81 expref: 15 pid: 13515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.049794:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:1.0:1787388102.049799:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.049822:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.049830:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.049851:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388102.049901:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+15:2402:x1874211925707264:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 184us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388102.049910:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00010000:00010000:3.0:1787388102.050259:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474a8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e81 expref: 14 pid: 13515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388102.050274:0:10197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945716992:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388102.050294:0:10197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.050314:0:10197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.050320:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787388102.056084:0:10197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1787388102.056223:0:10197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1787388102.056261:0:10197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1787388102.056364:0:10197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10197:1874211945717120:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787388102.056425:0:10197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388102.056455:0:10197:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787388102.056561:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945717120 00000100:00100000:0.0:1787388102.056567:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945717120 00000100:00100000:0.0:1787388102.056622:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787388102.056631:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10197:x1874211945717120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787388102.056699:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10197:x1874211945717120:12345-0@lo:1000:mdt00_003.0 Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388102.056706:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787388102.056912:0:10197:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787388102.056918:0:10197:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996b7f683480, transno 4294967304 00000100:00100000:1.0:1787388102.056938:0:10197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10197:1874211945717120:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787388102.057054:0:10197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1787388102.057092:0:10197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43922d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10197:1874211945717248:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787388102.057133:0:10197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388102.057152:0:10197:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74c8b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787388102.057247:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945717248 00000100:00100000:0.0:1787388102.057251:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945717248 00000100:00100000:0.0:1787388102.057282:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787388102.057288:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10197:x1874211945717248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787388102.057385:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10197:x1874211945717248:12345-0@lo:1000:mdt00_003.0 Request processed in 97us (251us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787388102.057392:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787388102.057458:0:10197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43922d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10197:1874211945717248:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787388102.057484:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057495:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057503:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057509:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388102.057520:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057528:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057542:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:1.0:1787388102.057545:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388102.057549:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057555:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474ad2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057581:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474a07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057587:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474a07 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057593:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474a07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057598:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388102.057601:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474a07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057606:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474a07 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057613:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:1.0:1787388102.057615:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388102.057622:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474a07 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057628:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474a07 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057650:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057663:0:10197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e65 expref: 17 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057671:0:10197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057694:0:10197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e65 expref: 17 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.057705:0:10197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e65 expref: 17 pid: 10197 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388102.057716:0:10197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945717376:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388102.057889:0:10197:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74c8b600 going to sleep for 11 seconds 00000100:00080000:3.0:1787388102.058164:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388102.062411:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388102.062678:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925707392 00000100:00100000:3.0:1787388102.062687:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925707392 00010000:00010000:3.0:1787388102.062728:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e65 expref: 18 pid: 10197 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388102.063222:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:3.0:1787388102.063235:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:2402:x1874211925707392:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388102.063250:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388102.063258:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e65 expref: 18 pid: 10197 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.063270:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e65 expref: 18 pid: 10197 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.063292:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:3.0:1787388102.063298:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.063307:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.063330:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.063540:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388102.063638:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:2402:x1874211925707392:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 406us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388102.063646:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00010000:00010000:2.0:1787388102.063752:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474a23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e65 expref: 17 pid: 10197 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388102.063776:0:10197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945717376:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388102.063797:0:10197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063806:0:10197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063811:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063822:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063836:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063843:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063848:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388102.063852:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063858:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063867:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:2.0:1787388102.063869:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388102.063872:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063876:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474ad9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063886:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063892:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063898:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063903:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388102.063911:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063918:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063927:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b728f7e00) 00010000:00010000:2.0:1787388102.063929:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787388102.063931:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.063937:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474acb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388102.064085:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+16:11328:x1874211925707008:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 29574us (29781us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787388102.064094:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 93 00000020:00080000:2.0:1787388102.064097:0:10197:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787388102.064334:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388102.064339:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388102.064385:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787388102.064391:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787388102.068005:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388102.068095:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925707648 00000100:00100000:2.0:1787388102.068104:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925707648 00000100:00100000:2.0:1787388102.068294:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:2.0:1787388102.068305:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+16:11328:x1874211925707648:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787388102.070488:0:6523:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787388102.070520:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1787388102.070554:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.070570:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.070581:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.070603:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.070609:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.070614:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.070631:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787388102.071254:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+18:11328:x1874211925707648:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 2947us (3253us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787388102.071264:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000020:00080000:2.0:1787388102.071270:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787388102.073375:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388102.073387:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.073398:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d200 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388102.073402:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.073411:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.073428:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:3.0:1787388102.073431:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787388102.073435:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.073440:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474ae0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.073452:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388102.073454:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388102.073455:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388102.241120:0:14213:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388102.241138:0:14213:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388102.241170:0:14213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787388102.241177:0:14213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787388102.253517:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388102.410544:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388102.410626:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925707904 00000100:00100000:1.0:1787388102.410636:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925707904 00000100:00100000:1.0:1787388102.410696:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 94 00000100:00100000:1.0:1787388102.410707:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+18:11338:x1874211925707904:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388102.410731:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388102.410762:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474ae7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7e9d expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.410868:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e600/0x26817551a4474aee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.410882:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e600/0x26817551a4474aee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.410894:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e600/0x26817551a4474aee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388102.410905:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787388102.411029:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474ae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e9d expref: 21 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.411047:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e600/0x26817551a4474aee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e9d expref: 20 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.411056:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:1.0:1787388102.411059:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388102.411075:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e600, rc 0) 00000100:00100000:1.0:1787388102.411142:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+20:11338:x1874211925707904:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 435us (606us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787388102.411150:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 94 00000100:00100000:1.0:1787388102.434184:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388102.434299:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925708032 00000100:00100000:0.0:1787388102.434308:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925708032 00000100:00100000:0.0:1787388102.434428:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 95 00000100:00100000:0.0:1787388102.434440:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+20:11338:x1874211925708032:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:0.0:1787388102.434517:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474afc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434534:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474afc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434546:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474afc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434561:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474b03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434568:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434575:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434643:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434662:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434669:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388102.434717:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434730:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474afc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434736:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474afc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434742:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474afc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434748:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388102.434752:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474afc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434760:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474afc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434772:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:0.0:1787388102.434775:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388102.434779:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474afc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434784:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474afc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434804:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434811:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474b03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434816:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474b03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434821:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388102.434824:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474b03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434829:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474b03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434836:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b74d22d00) 00010000:00010000:0.0:1787388102.434838:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388102.434840:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474b03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434846:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474b03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434859:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434865:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434870:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434880:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388102.434883:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434889:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434897:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b74d22f00) 00010000:00010000:0.0:1787388102.434899:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388102.434902:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.434907:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474b0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388102.435008:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+20:11338:x1874211925708032:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 569us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388102.435017:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 95 00000100:00100000:0.0:1787388102.512492:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388102.513475:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925708288 00000100:00100000:2.0:1787388102.513491:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925708288 00000100:00100000:2.0:1787388102.513579:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 96 00000100:00100000:2.0:1787388102.513592:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+20:11341:x1874211925708288:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388102.513621:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388102.513649:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a4474b11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ea4 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.513744:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474b18 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.513761:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474b18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.513777:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474b18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.513816:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474b1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.513825:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474b1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.513832:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474b1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514023:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514032:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514039:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388102.514049:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787388102.514150:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474b18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514158:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474b18 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514165:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474b18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514171:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388102.514177:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474b18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514196:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474b18 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514211:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388102.514214:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388102.514220:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474b18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514226:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474b18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514243:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474b1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514250:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474b1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514255:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474b1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514261:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388102.514264:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474b1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514271:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474b1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514277:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b43bd1700) 00010000:00010000:2.0:1787388102.514280:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388102.514283:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474b1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514298:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474b1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514415:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a4474b11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ea4 expref: 23 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514430:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ea4 expref: 22 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.514439:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:2.0:1787388102.514441:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388102.514444:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5ca00, rc 0) 00000100:00100000:2.0:1787388102.514526:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+22:11341:x1874211925708288:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 936us (2048us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787388102.514535:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 96 00000100:00100000:2.0:1787388102.517837:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388102.517972:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925708416 00000100:00100000:3.0:1787388102.518003:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925708416 00000100:00100000:3.0:1787388102.518080:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 97 00000100:00100000:3.0:1787388102.518105:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+22:11341:x1874211925708416:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:3.0:1787388102.518222:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.518242:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.518255:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.518297:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.518303:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.518310:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.518316:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388102.518320:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.518328:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.518342:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:3.0:1787388102.518625:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388102.518631:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.518652:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388102.518784:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+22:11341:x1874211925708416:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 691us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388102.518793:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 97 00000100:00100000:1.0:1787388102.530499:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388102.530933:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925708672 00000100:00100000:0.0:1787388102.530955:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925708672 00000100:00100000:0.0:1787388102.531039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1787388102.531051:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dccec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+22:11341:x1874211925708672:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1787388102.532038:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dccec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+23:11341:x1874211925708672:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 980us (1543us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1787388102.532049:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1787388102.602109:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388102.602453:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925708928 00000100:00100000:1.0:1787388102.602477:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925708928 00000100:00100000:1.0:1787388102.602575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 98 00000100:00100000:1.0:1787388102.602588:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+23:10866:x1874211925708928:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388102.602624:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388102.602650:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474b3b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7eab expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.603332:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.603389:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ea4 expref: 24 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.603400:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.603443:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ea4 expref: 24 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.603460:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ea4 expref: 24 pid: 10197 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388102.603978:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945717504:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388102.604112:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388102.611985:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388102.612866:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925709056 00000100:00100000:3.0:1787388102.612881:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925709056 00010000:00010000:3.0:1787388102.612939:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ea4 expref: 25 pid: 10197 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388102.613003:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:3.0:1787388102.613015:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+25:2402:x1874211925709056:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388102.613061:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388102.613070:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ea4 expref: 25 pid: 10197 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.613086:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ea4 expref: 25 pid: 10197 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.613113:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:3.0:1787388102.613119:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.613130:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.613138:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.613169:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388102.613249:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+25:2402:x1874211925709056:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 235us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388102.613259:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00010000:00010000:1.0:1787388102.613283:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474b26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ea4 expref: 24 pid: 10197 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388102.613307:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945717504:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388102.613332:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.613395:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.613404:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388102.613425:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787388102.613604:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474b3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eab expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.613621:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eab expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.613630:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:1.0:1787388102.613647:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388102.613651:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f200, rc 0) 00000100:00100000:1.0:1787388102.613692:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+24:10866:x1874211925708928:12345-192.168.203.15@tcp:101:bash.0 Request processed in 11106us (11597us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1787388102.613708:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 98 00000100:00100000:2.0:1787388102.616827:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388102.617129:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925709184 00000100:00100000:1.0:1787388102.617142:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925709184 00000100:00100000:1.0:1787388102.617220:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 99 00000100:00100000:1.0:1787388102.617232:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+24:10866:x1874211925709184:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388102.617267:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388102.617294:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474b50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7eb2 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.617338:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a4474b57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.617392:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a4474b57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.617406:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a4474b57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.617683:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474b50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eb2 expref: 26 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.617705:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a4474b57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eb2 expref: 25 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.617715:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:1.0:1787388102.618009:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388102.618014:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ea00, rc 0) 00000100:00100000:1.0:1787388102.618101:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+25:10866:x1874211925709184:12345-192.168.203.15@tcp:101:bash.0 Request processed in 870us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388102.618119:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 99 00000100:00100000:0.0:1787388102.623962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388102.624091:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925709440 00000100:00100000:3.0:1787388102.624104:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925709440 00000100:00100000:3.0:1787388102.624182:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 100 00000100:00100000:3.0:1787388102.624194:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+25:10866:x1874211925709440:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:3.0:1787388102.624548:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.624571:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.624586:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388102.624638:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1787388102.624670:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046a1b4ce reply state 00000000e74ec0b1 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.624685:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.624694:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:3.0:1787388102.624697:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388102.624701:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787388102.625070:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1787388102.625211:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+29:10866:x1874211925709440:12345-192.168.203.15@tcp:36:bash.0 Request processed in 1015us (1267us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787388102.625220:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 100 00000020:00080000:2.0:1787388102.625227:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787388102.637061:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388102.637184:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925709568 00000100:00100000:1.0:1787388102.637197:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925709568 00000100:00100000:1.0:1787388102.637274:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 101 00000100:00100000:1.0:1787388102.637286:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+29:10866:x1874211925709568:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388102.637320:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388102.637376:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474b65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7eb9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.637452:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474b65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eb9 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.637470:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474b65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eb9 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.637493:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:1.0:1787388102.637497:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388102.637502:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fc00, rc 0) 00000100:00100000:1.0:1787388102.637743:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+30:10866:x1874211925709568:12345-192.168.203.15@tcp:101:bash.0 Request processed in 458us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388102.637752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 101 00000100:00100000:1.0:1787388102.642464:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388102.642731:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925709696 00000100:00100000:2.0:1787388102.642744:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925709696 00000100:00100000:2.0:1787388102.642818:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:2.0:1787388102.642850:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:10866:x1874211925709696:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388102.642873:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388102.642898:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000687a906d/0x26817551a4474b6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ec0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787388102.642926:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8960c5, atime: 0x6a8960c3, ctime: 0x6a8960c5, blocks: 0x8 00010000:00010000:2.0:1787388102.642964:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=424s v=(0 0) 00010000:00010000:2.0:1787388102.642970:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388102.642979:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000687a906d/0x26817551a4474b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec0 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.643000:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000687a906d/0x26817551a4474b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec0 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388102.643015:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5da00, rc 0) 00000100:00100000:2.0:1787388102.643158:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:10866:x1874211925709696:12345-192.168.203.15@tcp:101:bash.0 Request processed in 310us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388102.643167:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:0.0:1787388102.651037:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388102.651157:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925709824 00000100:00100000:1.0:1787388102.651171:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925709824 00002000:00010000:1.0:1787388102.651226:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1787388102.651232:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b412aea00 with x1874211925709824 ext(0->18446744073709551615) 00002000:00010000:1.0:1787388102.651247:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b412aea00. 00000100:00100000:1.0:1787388102.651305:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:1.0:1787388102.651317:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925709824:12345-192.168.203.15@tcp:10:bash.0 00002000:00010000:1.0:1787388102.652179:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787388102.652186:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787388101 -> 1787388103 00002000:00010000:1.0:1787388102.652188:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787388099 -> 1787388099 00002000:00010000:1.0:1787388102.652191:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787388101 -> 1787388103 00002000:00010000:1.0:1787388102.652193:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787388102.652342:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925709824:12345-192.168.203.15@tcp:10:bash.0 Request processed in 1023us (1316us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787388102.652386:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00002000:00010000:1.0:1787388102.652391:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1787388102.652394:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b412aea00 with x1874211925709824 ext(0->18446744073709551615) 00002000:00010000:1.0:1787388102.652401:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b412aea00. 00000100:00100000:3.0:1787388102.784988:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388102.785532:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925709952 00000100:00100000:1.0:1787388102.785547:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925709952 00000100:00100000:1.0:1787388102.785631:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 102 00000100:00100000:1.0:1787388102.785643:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+30:11355:x1874211925709952:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:1.0:1787388102.785755:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474b73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.785775:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474b73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.785789:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474b73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.785807:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474b7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.785834:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474b7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.785842:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474b7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.785958:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.785969:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.785976:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388102.786036:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786050:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474b73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786057:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474b73 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786065:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474b73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786072:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388102.786077:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474b73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786086:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474b73 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786107:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:1.0:1787388102.786110:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388102.786128:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474b73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786134:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474b73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786150:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474b7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786157:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474b7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786162:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474b7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786167:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388102.786170:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474b7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786175:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474b7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786182:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b73adff00) 00010000:00010000:1.0:1787388102.786184:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388102.786187:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474b7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786193:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474b7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786219:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786225:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786230:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786235:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4ee00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388102.786238:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786244:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786251:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:1.0:1787388102.786253:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388102.786255:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.786261:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474b81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388102.786780:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+30:11355:x1874211925709952:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 1133us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388102.786791:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 102 00000100:00100000:2.0:1787388102.855754:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388102.855921:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925710208 00000100:00100000:3.0:1787388102.855962:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925710208 00000100:00100000:3.0:1787388102.856039:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 103 00000100:00100000:3.0:1787388102.856051:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+30:11358:x1874211925710208:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388102.856078:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388102.856105:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474b88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ec7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856212:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474b8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856230:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474b8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856242:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474b8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856258:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474b96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856265:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856271:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856478:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474b9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856489:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474b9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856497:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474b9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388102.856519:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787388102.856620:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474b8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856628:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474b8f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856635:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474b8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856641:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388102.856646:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474b8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856655:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474b8f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856669:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:3.0:1787388102.856673:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388102.856679:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474b8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856686:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474b8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856701:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856708:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474b96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856741:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474b96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856747:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388102.856751:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474b96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856758:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474b96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856766:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b51436c00) 00010000:00010000:3.0:1787388102.856769:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388102.856773:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474b96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856779:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474b96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856827:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474b88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec7 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856843:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474b9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec7 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388102.856851:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:3.0:1787388102.856854:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787388102.856857:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6c00, rc 0) 00000100:00100000:3.0:1787388102.856939:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+32:11358:x1874211925710208:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 891us (1203us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787388102.856965:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 103 00000100:00100000:2.0:1787388102.866266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388102.866636:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925710336 00000100:00100000:1.0:1787388102.866648:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925710336 00000100:00100000:1.0:1787388102.866728:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 104 00000100:00100000:1.0:1787388102.866759:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+32:11358:x1874211925710336:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:1.0:1787388102.866851:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.866871:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eab expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.866882:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.866923:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eab expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.866938:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eab expref: 32 pid: 6522 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388102.866966:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945717632:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388102.867098:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787388102.870045:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388102.870178:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925710592 00000100:00100000:0.0:1787388102.870191:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925710592 00000100:00100000:0.0:1787388102.870267:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:0.0:1787388102.870292:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+33:6170:x1874211925710592:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787388102.870692:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+34:6170:x1874211925710592:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 414us (659us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787388102.870701:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:1.0:1787388102.871979:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945717632:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388102.872014:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388102.880871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388102.883801:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925710720 00000100:00100000:1.0:1787388102.883823:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925710720 00010000:00010000:1.0:1787388102.883891:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eab expref: 34 pid: 6522 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388102.883966:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:1.0:1787388102.883997:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+34:2401:x1874211925710720:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388102.884034:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388102.884042:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eab expref: 34 pid: 6522 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.884059:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eab expref: 34 pid: 6522 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.884083:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474b42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eab expref: 34 pid: 6522 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.884103:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:1.0:1787388102.884109:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.884120:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.884128:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388102.884172:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388102.884261:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+33:2401:x1874211925710720:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 265us (3541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388102.884270:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 66 00010000:00010000:0.0:1787388102.890401:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.890425:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.890485:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.890494:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.890502:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.890509:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4ee00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388102.890514:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.890523:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.890547:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:0.0:1787388102.890575:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388102.890582:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388102.890589:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474bab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388102.890726:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+32:11358:x1874211925710336:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 23964us (24470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388102.890739:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 104 00000100:00100000:0.0:1787388102.892754:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945717760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388102.892840:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388102.892974:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945717760 00000100:00100000:3.0:1787388102.892984:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945717760 00000100:00100000:3.0:1787388102.893050:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787388102.893061:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945717760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388102.893104:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787388102.893186:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945717760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388102.893194:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787388102.893302:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945717760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388102.905005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388102.905157:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925710976 00000100:00100000:0.0:1787388102.905170:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925710976 00000100:00100000:0.0:1787388102.905240:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:0.0:1787388102.905252:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+32:11358:x1874211925710976:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1787388102.905595:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+33:11358:x1874211925710976:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 343us (603us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787388102.905605:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1787388103.055175:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.055394:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925711232 00000100:00100000:1.0:1787388103.055408:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925711232 00000100:00100000:1.0:1787388103.055504:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 105 00000100:00100000:1.0:1787388103.055517:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+33:11368:x1874211925711232:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:1.0:1787388103.055563:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388103.055588:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474bb2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ece expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.055687:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474bb9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.055705:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.055730:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.055747:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474bc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.055755:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.055761:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.055900:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474bc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.055910:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.055918:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388103.055949:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787388103.056050:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056058:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056065:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056072:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388103.056076:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056084:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056099:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:1.0:1787388103.056102:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388103.056106:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474bb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056112:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474bb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056127:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056132:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474bc0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056149:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056155:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388103.056158:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056175:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056182:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b73adff00) 00010000:00010000:1.0:1787388103.056185:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388103.056187:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474bc0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056192:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474bc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056241:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474bb2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ece expref: 36 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056255:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ece expref: 35 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.056262:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:1.0:1787388103.056264:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388103.056266:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e400, rc 0) 00000100:00100000:1.0:1787388103.057050:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+35:11368:x1874211925711232:12345-192.168.203.15@tcp:101:cat.0 Request processed in 1528us (1896us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787388103.057073:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 105 00000100:00100000:2.0:1787388103.078399:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.081053:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925711488 00000100:00100000:0.0:1787388103.081080:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925711488 00000100:00100000:0.0:1787388103.081485:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:0.0:1787388103.081499:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+35:11368:x1874211925711488:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:0.0:1787388103.081922:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+36:11368:x1874211925711488:12345-192.168.203.15@tcp:35:cat.0 Request processed in 424us (3576us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787388103.081930:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:2.0:1787388103.101106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.101406:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925711744 00000100:00100000:0.0:1787388103.101438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925711744 00000100:00100000:0.0:1787388103.101508:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 106 00000100:00100000:0.0:1787388103.101520:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+36:11370:x1874211925711744:12345-192.168.203.15@tcp:36:rm.0 00010000:00010000:0.0:1787388103.101658:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787388103.101692:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474b65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eb9 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.101791:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474bc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ece expref: 35 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.101807:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474b9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec7 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.101821:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a4474b57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eb2 expref: 33 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.101831:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:0.0:1787388103.101837:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388103.101865:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bd5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.101881:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.101892:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.101907:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.101926:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.101933:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102047:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474be3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102056:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474be3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102063:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474be3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787388103.102796:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1787388103.102810:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424625462381ns, next at 425625459462ns, rc = 0 00010000:00010000:0.0:1787388103.102871:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102883:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102893:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102901:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102907:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102929:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102960:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388103.102985:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474be3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102991:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474be3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.102998:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474be3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103004:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388103.103009:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474be3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103017:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474be3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103030:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:0.0:1787388103.103032:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787388103.103038:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474be3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103043:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474be3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103067:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103073:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bd5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103086:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bd5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103091:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030c00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388103.103093:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bd5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103099:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bd5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103107:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:0.0:1787388103.103119:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388103.103123:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bd5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103129:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bd5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388103.103142:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d277221f reply state 00000000e5058118 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103153:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.103158:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b74d22f00) 00010000:00010000:1.0:1787388103.103746:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388103.103756:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.103763:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388103.103767:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.103774:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.103785:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:1.0:1787388103.103787:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787388103.103790:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.103795:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474bea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.103810:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388103.103812:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388103.103814:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388103.103954:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388103.103960:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787388103.104089:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+34:11370:x1874211925711744:12345-192.168.203.15@tcp:36:rm.0 Request processed in 2565us (2991us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787388103.104099:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 106 00000100:00100000:2.0:1787388103.178955:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.179102:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925712000 00000100:00100000:0.0:1787388103.179125:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925712000 00000100:00100000:0.0:1787388103.179214:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 107 00000100:00100000:0.0:1787388103.179226:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+34:11376:x1874211925712000:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1787388103.179258:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388103.179296:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bf1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ed5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.179926:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474bf8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.179954:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474bf8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.179968:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474bf8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.179982:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.179991:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.179997:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388103.180660:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787388103.181076:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181091:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181102:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181394:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474bf8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181403:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474bf8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181432:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474bf8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181438:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388103.181443:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474bf8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181451:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474bf8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181466:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388103.181469:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388103.181475:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474bf8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181481:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474bf8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388103.181498:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f83da681 reply state 00000000618fef0a transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181510:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181517:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b74d22f00) 00010000:00010000:2.0:1787388103.181519:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388103.181522:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787388103.181565:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474bf1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ed5 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181583:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ed5 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.181598:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b43bd1a00) 00010000:00010000:2.0:1787388103.181601:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388103.181603:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c600, rc 0) 00000100:00100000:2.0:1787388103.181832:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+37:11376:x1874211925712000:12345-192.168.203.15@tcp:101:bash.0 Request processed in 2606us (2901us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787388103.181842:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 107 00000100:00100000:3.0:1787388103.191524:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.192828:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925712128 00000100:00100000:0.0:1787388103.192848:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925712128 00000100:00100000:0.0:1787388103.193021:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:0.0:1787388103.193036:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+7:2401:x1874211925712128:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1787388103.193059:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388103.193087:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a4474c14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7edc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388103.193129:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388103.193157:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787388103.193163:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388103.193174:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a4474c14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7edc expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.193196:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a4474c14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7edc expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.193212:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031200, rc 0) 00000100:00100000:0.0:1787388103.193303:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925712128:12345-192.168.203.15@tcp:101:bash.0 Request processed in 271us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388103.193331:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00080000:3.0:1787388103.197373:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388103.210515:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388103.210701:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925712256 00000100:00100000:2.0:1787388103.210723:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925712256 00000100:00100000:2.0:1787388103.210801:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:2.0:1787388103.210812:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+8:11376:x1874211925712256:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388103.210835:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388103.210861:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ee3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.210898:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a4474c14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7edc expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.210907:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388103.210912:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388103.210919:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.210967:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a4474c14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7edc expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.211011:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a4474c14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7edc expref: 9 pid: 8436 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388103.211027:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874211945717888:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388103.211156:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787388103.229590:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.229793:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874211945717888:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388103.229835:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.229863:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d600, rc 0) 00000100:00100000:0.0:1787388103.229952:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+9:11376:x1874211925712256:12345-192.168.203.15@tcp:101:bash.0 Request processed in 19140us (19449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388103.229962:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:3.0:1787388103.230130:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925712384 00000100:00100000:3.0:1787388103.230140:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925712384 00010000:00010000:3.0:1787388103.230193:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a4474c14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7edc expref: 9 pid: 8436 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388103.230232:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:3.0:1787388103.230242:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+9:2402:x1874211925712384:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388103.230258:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388103.230296:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a4474c14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7edc expref: 9 pid: 8436 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.230311:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a4474c14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7edc expref: 9 pid: 8436 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.230422:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a4474c14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7edc expref: 9 pid: 8436 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.230441:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388103.230445:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388103.230452:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.230463:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.230515:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388103.230531:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1874211945718016:192.168.203.15@tcp:105: 00000100:00100000:3.0:1787388103.230596:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388103.236266:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1874211945718016:192.168.203.15@tcp:105: 00010000:00010000:1.0:1787388103.236293:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388103.236369:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925712384:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 6127us (6792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.236381:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:2.0:1787388103.242731:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.242844:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925712640 00000100:00100000:0.0:1787388103.242858:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925712640 00000100:00100000:0.0:1787388103.242928:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1787388103.242954:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+37:11376:x1874211925712640:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:0.0:1787388103.243609:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+38:11376:x1874211925712640:12345-192.168.203.15@tcp:35:bash.0 Request processed in 668us (901us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787388103.243618:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00010000:00010000:1.0:1787388103.276608:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388103.440709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.440877:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925712768 00000100:00100000:1.0:1787388103.440892:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925712768 00000100:00100000:1.0:1787388103.440981:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 108 00000100:00100000:1.0:1787388103.440993:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+38:11392:x1874211925712768:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388103.441023:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388103.441052:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474c22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7eea expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.441213:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474c29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.441229:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474c29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.441243:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474c29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388103.441312:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787388103.441317:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388103.441338:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474c29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.441414:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4474c22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eea expref: 40 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.441436:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474c29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eea expref: 39 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.441446:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:1.0:1787388103.441449:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388103.441472:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f000, rc 0) 00000100:00100000:1.0:1787388103.444874:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+39:11392:x1874211925712768:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 723us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.444893:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 108 00000100:00100000:1.0:1787388103.446691:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.446802:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925713024 00000100:00100000:0.0:1787388103.446815:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925713024 00000100:00100000:0.0:1787388103.446925:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 109 00000100:00100000:0.0:1787388103.446945:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+39:11392:x1874211925713024:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388103.446973:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388103.447000:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ef1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.447143:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.447179:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.447194:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388103.447210:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787388103.447403:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ef1 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.447425:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ef1 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.447434:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b43bd1a00) 00010000:00010000:0.0:1787388103.447437:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388103.447441:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030000, rc 0) 00000100:00100000:0.0:1787388103.447596:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+41:11392:x1874211925713024:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 661us (918us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1787388103.447604:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 109 00000100:00100000:2.0:1787388103.458719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388103.458778:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388103.458829:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925713408 00000100:00100000:2.0:1787388103.458842:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925713408 00000100:00100000:2.0:1787388103.458920:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 110 00000100:00100000:2.0:1787388103.458933:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+41:11392:x1874211925713408:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388103.458977:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388103.459005:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474c45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ef8 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.459174:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474c4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.459194:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474c4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.459207:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474c4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388103.459250:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787388103.459420:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474c45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ef8 expref: 44 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.459442:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474c4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ef8 expref: 43 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.459453:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b43bd1a00) 00010000:00010000:2.0:1787388103.459455:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787388103.459459:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d400, rc 0) 00000100:00100000:2.0:1787388103.459533:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+43:11392:x1874211925713408:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 603us (754us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1787388103.459541:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 110 00000100:00100000:3.0:1787388103.460057:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925713152 00000100:00100000:3.0:1787388103.460066:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925713152 00000100:00100000:3.0:1787388103.460129:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1787388103.460139:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+43:2400:x1874211925713152:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388103.460151:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388103.460170:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ef1 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.460200:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b43bd1a00) 00010000:00010000:3.0:1787388103.460203:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388103.460241:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+42:2400:x1874211925713152:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 104us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.460248:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1787388103.477438:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.477593:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925713536 00000100:00100000:1.0:1787388103.477606:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925713536 00000100:00100000:1.0:1787388103.477684:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:1.0:1787388103.477697:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925713536:12345-192.168.203.15@tcp:1:lfs.0 00010000:00010000:1.0:1787388103.477756:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.477780:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.477800:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388103.477806:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388103.477811:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.477856:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.477873:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 8 pid: 8437 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388103.477890:0:8490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f682680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874211945718144:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388103.478029:0:8490:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388103.481608:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388103.481828:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925713664 00000100:00100000:3.0:1787388103.481841:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925713664 00002000:00100000:3.0:1787388103.481905:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff996b52ef1f80 x1874211925713664/t0(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:359/0 lens 504/0 e 0 to 0 dl 1787388114 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787388103.481917:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b52ef1f80 with x1874211925713664 ext(0->8) 00010000:00010000:3.0:1787388103.481928:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 9 pid: 8437 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.481957:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 9 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388103.481965:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996b52ef1f80 00000100:00100000:3.0:1787388103.482004:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:3.0:1787388103.482015:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00e97fed-41ea-4716-be07-f037d23906cf+9:2401:x1874211925713664:12345-192.168.203.15@tcp:4:lfs.0 00000100:00100000:1.0:1787388103.483036:0:8490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f682680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874211945718144:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388103.483068:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388103.483701:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00e97fed-41ea-4716-be07-f037d23906cf+11:2401:x1874211925713664:12345-192.168.203.15@tcp:4:lfs.0 Request processed in 1683us (2104us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787388103.483725:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00002000:00100000:3.0:1787388103.483737:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff996b52ef1f80 x1874211925713664/t4294967303(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:359/0 lens 504/448 e 0 to 0 dl 1787388114 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787388103.483759:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b52ef1f80 with x1874211925713664 ext(0->8) 00010000:00010000:3.0:1787388103.483769:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 11 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.483787:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 11 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388103.483795:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996b52ef1f80 00000100:00100000:2.0:1787388103.496234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.496411:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925713792 00000100:00100000:1.0:1787388103.496425:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925713792 00010000:00010000:1.0:1787388103.496478:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 11 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388103.496533:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:1.0:1787388103.496545:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+11:2402:x1874211925713792:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388103.496566:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787388103.496590:0:7462:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787388103.496593:0:7462:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787388103 00002000:00010000:1.0:1787388103.496596:0:7462:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787388103 00002000:00010000:1.0:1787388103.496598:0:7462:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787388103 00002000:00010000:1.0:1787388103.496599:0:7462:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787388103.496607:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 11 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.496621:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 11 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.496651:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4474c1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ee3 expref: 11 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.496695:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1787388103.496700:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388103.496706:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.496717:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.496816:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388103.496882:0:8490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.496894:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.496919:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.496949:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.496957:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.496965:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388103.496971:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.496981:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388103.496983:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+10:2402:x1874211925713792:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 440us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.496992:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00010000:00010000:0.0:1787388103.496994:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.497001:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad10884/0x26817551a4474c5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388103.497053:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+9:2401:x1874211925713536:12345-192.168.203.15@tcp:1:lfs.0 Request processed in 19359us (19631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388103.497062:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:2.0:1787388103.502667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.502762:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925714048 00000100:00100000:0.0:1787388103.502777:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925714048 00000100:00100000:0.0:1787388103.502857:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:0.0:1787388103.502887:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dcca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+42:11392:x1874211925714048:12345-192.168.203.15@tcp:35:lfs.0 00000004:00010000:0.0:1787388103.502982:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474c4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ef8 expref: 42 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388103.503225:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1787388103.503260:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787388103.503795:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1787388103.503845:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.503864:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ed5 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.503874:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.503917:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ed5 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.503935:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ed5 expref: 46 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388103.503962:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874211945718272:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388103.504064:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388103.510600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388103.510920:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925714176 00000100:00100000:3.0:1787388103.510932:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925714176 00010000:00010000:3.0:1787388103.510997:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ed5 expref: 47 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388103.511085:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:3.0:1787388103.511098:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+47:2402:x1874211925714176:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388103.511128:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388103.511137:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ed5 expref: 47 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.511154:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ed5 expref: 47 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.511196:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b43bd1a00) 00010000:00010000:3.0:1787388103.511202:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.511238:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.511248:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.511271:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388103.511424:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+47:2402:x1874211925714176:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 328us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.511433:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00010000:00010000:0.0:1787388103.511436:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474c06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ed5 expref: 47 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388103.511455:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874211945718272:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388103.511506:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.511518:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.511524:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388103.511674:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1787388103.511830:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1787388103.511951:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945718400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787388103.512018:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388103.512059:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517f6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388103.512571:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945718400 00000100:00100000:2.0:1787388103.512579:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945718400 00000100:00100000:2.0:1787388103.512651:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787388103.512660:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1874211945718400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787388103.512784:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1874211945718400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 125us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388103.512792:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1787388103.512980:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388103.513017:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945718400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787388103.513166:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1787388103.513237:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945718528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787388103.513274:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388103.513298:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b729819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388103.513403:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945718528 00000100:00100000:1.0:1787388103.513409:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945718528 00000100:00100000:1.0:1787388103.513446:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787388103.513455:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1874211945718528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787388103.513576:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6523:x1874211945718528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (301us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787388103.513584:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787388103.514080:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945718528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787388103.514139:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1787388103.514187:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.514200:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.514208:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.514233:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388103.514238:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.514246:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.514265:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b43bd1a00) 00010000:00010000:0.0:1787388103.514268:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787388103.514273:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.514280:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c61 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787388103.514456:0:6523:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787388103.514776:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1787388103.514925:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425037576775ns, next at 426037572851ns, rc = 0 00000001:00080000:0.0:1787388103.514946:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1787388103.514981:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b43bd1a00) 00010000:00010000:0.0:1787388103.514984:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787388103.514995:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4474c4c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ef8 expref: 50 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388103.515131:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dcca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+49:11392:x1874211925714048:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 12246us (12476us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787388103.515141:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 26 00000020:00080000:0.0:1787388103.515147:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787388103.518641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.518810:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925714304 00000100:00100000:1.0:1787388103.518823:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925714304 00000100:00100000:1.0:1787388103.518931:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 111 00000100:00100000:1.0:1787388103.518952:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+49:11392:x1874211925714304:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388103.518983:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388103.519012:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474c68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7eff expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.519106:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474c68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eff expref: 50 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.519135:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474c68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eff expref: 50 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.519157:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388103.519161:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388103.519165:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fa00, rc 0) 00000100:00100000:1.0:1787388103.519289:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+50:11392:x1874211925714304:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 338us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.519297:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 111 00000100:00100000:1.0:1787388103.528055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388103.528335:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925714560 00000100:00100000:3.0:1787388103.528366:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925714560 00000100:00100000:3.0:1787388103.528435:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:3.0:1787388103.528447:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+50:11392:x1874211925714560:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1787388103.529032:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+51:11392:x1874211925714560:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 583us (988us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787388103.529043:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:2.0:1787388103.632823:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.633011:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925714688 00000100:00100000:0.0:1787388103.633025:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925714688 00000100:00100000:0.0:1787388103.633104:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 112 00000100:00100000:0.0:1787388103.633116:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+51:11402:x1874211925714688:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:0.0:1787388103.633230:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c6f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633252:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633266:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633281:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633289:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633297:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633456:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633466:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633474:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388103.633533:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633560:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633567:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c6f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633574:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633581:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388103.633586:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633594:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c6f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633607:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:0.0:1787388103.633610:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388103.633615:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633621:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633638:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633645:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633650:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633662:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388103.633665:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633672:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633681:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b74d22f00) 00010000:00010000:0.0:1787388103.633683:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388103.633687:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633693:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633705:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633711:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633718:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633723:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388103.633726:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633731:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633750:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:0.0:1787388103.633763:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388103.633767:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.633773:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388103.633865:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+51:11402:x1874211925714688:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 749us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388103.633874:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 112 00000100:00100000:2.0:1787388103.680202:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.680319:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925714944 00000100:00100000:0.0:1787388103.680340:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925714944 00000100:00100000:0.0:1787388103.680449:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 113 00000100:00100000:0.0:1787388103.680459:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+51:11405:x1874211925714944:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388103.680495:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388103.680523:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f06 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.680621:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.680641:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.680656:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.680669:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.680697:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.680705:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.680867:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.680876:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.680883:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388103.680894:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787388103.681001:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681009:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681016:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681021:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388103.681027:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681035:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681073:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:0.0:1787388103.681077:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388103.681082:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681094:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474c8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681112:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681124:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681129:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681135:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388103.681138:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681144:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681155:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b74d22f00) 00010000:00010000:0.0:1787388103.681158:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388103.681161:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681167:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474c92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681243:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474c84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f06 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681258:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f06 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.681265:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:0.0:1787388103.681267:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388103.681270:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030c00, rc 0) 00000100:00100000:0.0:1787388103.681391:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+53:11405:x1874211925714944:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 890us (1162us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787388103.681400:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 113 00000100:00100000:1.0:1787388103.694838:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.694994:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925715072 00000100:00100000:0.0:1787388103.695009:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925715072 00000100:00100000:0.0:1787388103.695087:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 114 00000100:00100000:0.0:1787388103.695098:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+53:11405:x1874211925715072:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:0.0:1787388103.695198:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474ca7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.695219:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.695233:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.695277:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.695309:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.695317:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.695323:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388103.695328:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.695428:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.695444:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:0.0:1787388103.695448:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388103.695454:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474ca7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.695717:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474ca7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388103.695833:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+53:11405:x1874211925715072:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 736us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388103.695848:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 114 00000100:00100000:2.0:1787388103.704460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.704826:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925715328 00000100:00100000:0.0:1787388103.704842:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925715328 00000100:00100000:0.0:1787388103.704931:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:0.0:1787388103.705103:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+53:11405:x1874211925715328:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1787388103.705440:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+54:11405:x1874211925715328:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 340us (994us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1787388103.705478:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:2.0:1787388103.789950:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.790029:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925715584 00000100:00100000:0.0:1787388103.790043:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925715584 00000100:00100000:2.0:1787388103.790890:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:2.0:1787388103.790922:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+54:11415:x1874211925715584:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388103.790967:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388103.790970:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787388103.791005:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4474c29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eea expref: 54 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.791028:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388103.791034:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388103.791052:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474cae lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f0d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.791219:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.791236:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f06 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.791246:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.791287:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f06 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.791301:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f06 expref: 54 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388103.791339:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945718656:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388103.791494:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787388103.795893:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945718656:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388103.795947:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388103.797633:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388103.798492:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925715712 00000100:00100000:3.0:1787388103.798505:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925715712 00010000:00010000:3.0:1787388103.798551:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f06 expref: 55 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388103.798591:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:3.0:1787388103.798602:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+55:2401:x1874211925715712:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388103.798620:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388103.798627:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f06 expref: 55 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.798661:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f06 expref: 55 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.798687:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4474c99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f06 expref: 55 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.798708:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:3.0:1787388103.800556:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.800588:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.800598:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.800654:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388103.800757:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+54:2401:x1874211925715712:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 2150us (3132us total) trans 0 rc 0/0 00010000:00010000:2.0:1787388103.800761:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388103.800770:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00010000:00010000:2.0:1787388103.800771:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388103.800797:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787388103.801018:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474cae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f0d expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.801039:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f0d expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.801047:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:2.0:1787388103.801050:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787388103.801053:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5ca00, rc 0) 00000100:00100000:2.0:1787388103.801084:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+54:11415:x1874211925715584:12345-192.168.203.15@tcp:101:bash.0 Request processed in 10174us (11159us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787388103.801092:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:3.0:1787388103.816587:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388103.816777:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925715840 00000100:00100000:2.0:1787388103.816791:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925715840 00000100:00100000:2.0:1787388103.816867:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:2.0:1787388103.816879:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+54:11415:x1874211925715840:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388103.816910:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388103.816945:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474cc3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f14 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.816991:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.817010:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.817024:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.817181:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474cc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f14 expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.817201:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f14 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.817210:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:2.0:1787388103.817214:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787388103.817218:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d000, rc 0) 00000100:00100000:2.0:1787388103.817301:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+55:11415:x1874211925715840:12345-192.168.203.15@tcp:101:bash.0 Request processed in 424us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388103.817308:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:0.0:1787388103.842621:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388103.842766:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925716096 00000100:00100000:3.0:1787388103.842783:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925716096 00000100:00100000:3.0:1787388103.842861:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:3.0:1787388103.842873:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+55:11415:x1874211925716096:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:3.0:1787388103.843188:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.843234:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.843248:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388103.843302:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1787388103.843329:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004cc122d8 reply state 000000005d50f8eb transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.843344:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.843399:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:3.0:1787388103.843403:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388103.843407:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388103.843531:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+58:11415:x1874211925716096:12345-192.168.203.15@tcp:36:bash.0 Request processed in 659us (918us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787388103.843540:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 117 00000020:00080000:3.0:1787388103.843546:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787388103.847755:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388103.847948:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925716224 00000100:00100000:2.0:1787388103.847969:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925716224 00000100:00100000:2.0:1787388103.848048:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:2.0:1787388103.848061:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+58:11415:x1874211925716224:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388103.848111:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388103.848138:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474cd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f1b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.848264:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.848283:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f0d expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.848294:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.848339:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f0d expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.848407:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f0d expref: 59 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388103.848426:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945718784:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388103.848564:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787388103.850989:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945718784:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388103.851020:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388103.851408:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388103.851745:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925716352 00000100:00100000:3.0:1787388103.851757:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925716352 00010000:00010000:3.0:1787388103.851810:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f0d expref: 60 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388103.851862:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:3.0:1787388103.851873:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+60:2399:x1874211925716352:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388103.851891:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388103.851910:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f0d expref: 60 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.851955:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f0d expref: 60 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.852214:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474cb5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f0d expref: 60 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.852235:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:3.0:1787388103.852241:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.852250:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.852259:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388103.852284:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388103.852394:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+59:2399:x1874211925716352:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 523us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.852403:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 71 00010000:00010000:0.0:1787388103.852828:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.852839:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388103.852924:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787388103.852931:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388103.852978:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.853021:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474cd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f1b expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.853040:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f1b expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.853048:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:0.0:1787388103.853051:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388103.853054:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c200, rc 0) 00000100:00100000:0.0:1787388103.853319:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+58:11415:x1874211925716224:12345-192.168.203.15@tcp:101:bash.0 Request processed in 5259us (5576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388103.853341:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:2.0:1787388103.860454:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388103.863012:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925716608 00000100:00100000:3.0:1787388103.863032:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925716608 00000100:00100000:3.0:1787388103.863141:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:3.0:1787388103.863154:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+58:11415:x1874211925716608:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:3.0:1787388103.863494:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+59:11415:x1874211925716608:12345-192.168.203.15@tcp:35:bash.0 Request processed in 341us (3053us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787388103.863504:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:1.0:1787388103.916712:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388103.916745:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945718912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388103.916852:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388103.917055:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945718912 00000100:00100000:2.0:1787388103.917073:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945718912 00000100:00100000:2.0:1787388103.918058:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787388103.918085:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945718912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388103.918278:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388103.918394:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945718912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 321us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388103.918403:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1787388103.918526:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388103.918581:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945718912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388103.919382:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945719040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388103.919443:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388103.920125:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945719040 00000100:00100000:3.0:1787388103.920136:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945719040 00000100:00100000:3.0:1787388103.920208:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787388103.920219:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3652:x1874211945719040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388103.920243:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388103.920306:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3652:x1874211945719040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.920314:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787388103.920967:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945719424:0@lo:400:kworker.0 00000100:00100000:2.0:1787388103.921015:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388103.921039:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945719936:0@lo:400:kworker.0 00000100:00100000:2.0:1787388103.921061:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388103.921083:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945720448:0@lo:400:kworker.0 00000100:00100000:2.0:1787388103.921102:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388103.921124:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787388103.921130:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945719552:0@lo:400:kworker.0 00000100:00100000:2.0:1787388103.921152:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388103.921687:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945719040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388103.921777:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945720064:0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.921894:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945719168:0@lo:400:kworker.0 00000100:00100000:0.0:1787388103.921953:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945719936 00000100:00100000:0.0:1787388103.921960:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945719936 00000100:00100000:0.0:1787388103.922018:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945720448 00000100:00100000:0.0:1787388103.922022:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945720448 00000100:00100000:0.0:1787388103.922044:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945719552 00000100:00100000:0.0:1787388103.922047:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945719552 00000100:00100000:0.0:1787388103.922063:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787388103.922072:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945719936:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787388103.922137:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388103.931287:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388103.931381:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945719680:0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.931429:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388103.931454:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945720192:0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.931480:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388103.931517:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787388103.931525:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945719296:0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.931551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388103.931563:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945719808:0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.931581:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388103.931592:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945720320:0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.931616:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388103.931662:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945720192 00000100:00100000:3.0:1787388103.931672:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945720192 00000100:00100000:3.0:1787388103.931749:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787388103.931761:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945720192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.931828:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945720192:12345-0@lo:400:kworker.0 Request processed in 68us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.931853:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787388103.931902:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945720192:0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.931931:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945719296 00000100:00100000:3.0:1787388103.931944:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945719296 00000100:00100000:3.0:1787388103.931967:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945719808 00000100:00100000:3.0:1787388103.931969:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945719808 00000100:00100000:3.0:1787388103.931993:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945720320 00000100:00100000:3.0:1787388103.931995:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945720320 00000100:00100000:3.0:1787388103.932011:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787388103.932020:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945720448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.932064:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945720448:12345-0@lo:400:kworker.0 Request processed in 46us (10961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.932070:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787388103.932087:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787388103.932094:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945719552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.932124:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945719552:12345-0@lo:400:kworker.0 Request processed in 31us (10971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.932130:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787388103.932144:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787388103.932149:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945719296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.932181:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945719296:12345-0@lo:400:kworker.0 Request processed in 32us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.932187:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787388103.932197:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787388103.932202:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945719808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.932245:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945719808:12345-0@lo:400:kworker.0 Request processed in 40us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.932252:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787388103.932263:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787388103.932269:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945720320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.932296:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945720320:12345-0@lo:400:kworker.0 Request processed in 27us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.932302:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787388103.932333:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945719296:0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.932342:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945719808:0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.932379:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945720320:0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.932454:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945719424 00000100:00100000:3.0:1787388103.932458:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945719424 00000100:00100000:3.0:1787388103.932486:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945719680 00000100:00100000:3.0:1787388103.932489:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945719680 00000100:00100000:3.0:1787388103.932503:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787388103.932509:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945719424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.932547:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945719424:12345-0@lo:400:kworker.0 Request processed in 38us (11531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.932553:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787388103.932569:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787388103.932574:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945719680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388103.932626:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945719680:12345-0@lo:400:kworker.0 Request processed in 51us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388103.932640:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787388103.932674:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945719680:0@lo:400:kworker.0 00000100:00100000:1.0:1787388103.933281:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945719168 00000100:00100000:1.0:1787388103.933289:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945719168 00000100:00100000:1.0:1787388103.933337:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787388103.933359:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945719168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388103.933419:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945719168:12345-0@lo:400:kworker.0 Request processed in 74us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.933426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:1.0:1787388103.933470:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388103.933503:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945719168:0@lo:400:kworker.0 00000100:00100000:2.0:1787388103.942729:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388103.942836:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945719424:0@lo:400:kworker.0 00010000:00080000:2.0:1787388103.942859:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f5e2300 x1874211945720448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388103.942870:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945720448:0@lo:400:kworker.0 00000100:00100000:2.0:1787388103.942904:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945719552:0@lo:400:kworker.0 00000100:00100000:1.0:1787388103.943142:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.943198:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.943232:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925716992 00000100:00100000:1.0:1787388103.943241:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925716992 00000100:00100000:1.0:1787388103.943315:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 316 00000100:00100000:1.0:1787388103.943327:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925716992:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388103.943442:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925716992:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 116us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.943449:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 316 00000100:00080000:1.0:1787388103.943475:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388103.943510:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.943655:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.943675:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925717504 00000100:00100000:1.0:1787388103.943680:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925717504 00000100:00100000:1.0:1787388103.943722:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 317 00000100:00100000:1.0:1787388103.943729:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925717504:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388103.943762:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925717504:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.943787:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 317 00000100:00080000:1.0:1787388103.943803:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388103.943848:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.943884:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.943906:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945720064 00000100:00100000:1.0:1787388103.943911:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945720064 00000100:00100000:1.0:1787388103.943957:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925717248 00000100:00100000:1.0:1787388103.943960:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925717248 00000100:00100000:1.0:1787388103.943975:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925717120 00000100:00100000:1.0:1787388103.943978:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925717120 00000100:00100000:1.0:1787388103.943992:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787388103.943998:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945720064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388103.944044:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945720064:12345-0@lo:400:kworker.0 Request processed in 46us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.944051:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787388103.944062:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 112 00000100:00100000:1.0:1787388103.944068:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+9:2400:x1874211925717248:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388103.944093:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+9:2400:x1874211925717248:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.944099:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 112 00000100:00100000:1.0:1787388103.944110:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 113 00000100:00100000:1.0:1787388103.944115:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2400:x1874211925717120:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388103.944137:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2400:x1874211925717120:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 22us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.944143:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 113 00000100:00080000:1.0:1787388103.944168:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388103.944179:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925716864 00000100:00100000:1.0:1787388103.944183:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925716864 00000100:00100000:1.0:1787388103.944207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 318 00000100:00100000:1.0:1787388103.944214:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+59:2400:x1874211925716864:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388103.944248:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+59:2400:x1874211925716864:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 35us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.944255:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 318 00000100:00100000:1.0:1787388103.944295:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.944310:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925717376 00000100:00100000:1.0:1787388103.944314:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925717376 00000100:00100000:1.0:1787388103.944338:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 319 00000100:00100000:1.0:1787388103.944366:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925717376:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388103.944393:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925717376:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 48us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.944399:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 319 00000100:00080000:1.0:1787388103.944413:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388103.944817:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925716736 00000100:00100000:2.0:1787388103.944833:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925716736 00000100:00100000:2.0:1787388103.944873:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 389 00000100:00100000:2.0:1787388103.944881:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925716736:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388103.944924:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925716736:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 44us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388103.944931:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 389 00000100:00100000:2.0:1787388103.944999:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945720064:0@lo:400:kworker.0 00000100:00100000:0.0:1787388103.955149:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945719936:12345-0@lo:400:kworker.0 Request processed in 33061us (34069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388103.955171:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00080000:2.0:1787388103.955438:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f5e0e00 x1874211945719936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388103.955458:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945719936:0@lo:400:kworker.0 00000100:00100000:1.0:1787388103.969664:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388103.969846:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925717632 00000100:00100000:2.0:1787388103.969860:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925717632 00000100:00100000:2.0:1787388103.969942:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 119 00000100:00100000:2.0:1787388103.969955:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+59:11421:x1874211925717632:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388103.969985:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388103.970012:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474ce6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f22 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.970099:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474ced lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.970127:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.970141:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388103.970231:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787388103.970236:0:10197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388103.970261:0:10197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.970290:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474ce6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f22 expref: 61 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.970311:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474ced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f22 expref: 60 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.970321:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388103.970324:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388103.970329:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c400, rc 0) 00000100:00100000:2.0:1787388103.970645:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+60:11421:x1874211925717632:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 691us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388103.970654:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 119 00000100:00100000:3.0:1787388103.978702:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.979479:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925717760 00000100:00100000:1.0:1787388103.979495:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925717760 00000100:00100000:1.0:1787388103.979724:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:1.0:1787388103.979738:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+60:11421:x1874211925717760:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388103.979765:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388103.979791:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474cf4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.979912:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474cfb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.979948:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474cfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.979962:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474cfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.979977:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.979985:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.979991:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980091:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474d09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980101:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980119:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388103.980337:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787388103.980343:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388103.980396:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980412:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980433:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474cfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980439:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474cfb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980445:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474cfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980451:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4ee00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388103.980456:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474cfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980464:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474cfb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980478:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:1.0:1787388103.980482:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388103.980487:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474cfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980493:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474cfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980507:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980513:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980518:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980530:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388103.980533:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980539:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980547:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b74d22f00) 00010000:00010000:1.0:1787388103.980549:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388103.980552:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980557:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980589:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4474cf4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f29 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980603:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474d09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f29 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388103.980610:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388103.980613:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388103.980615:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f800, rc 0) 00000100:00100000:1.0:1787388103.980765:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+61:11421:x1874211925717760:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1030us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388103.980774:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:1.0:1787388103.986296:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388103.986487:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388103.986579:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925718144 00000100:00100000:2.0:1787388103.986592:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925718144 00000100:00100000:2.0:1787388103.986676:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:2.0:1787388103.986689:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+61:2401:x1874211925718144:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388103.986710:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388103.986751:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474d09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f29 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.986776:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:2.0:1787388103.986790:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388103.986863:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+60:2401:x1874211925718144:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 176us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388103.986871:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:0.0:1787388103.990635:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925718016 00000100:00100000:0.0:1787388103.990656:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925718016 00000100:00100000:2.0:1787388103.990941:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:2.0:1787388103.990956:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+60:11421:x1874211925718016:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388103.990984:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388103.991011:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f30 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.991168:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.991185:0:13515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f1b expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.991194:0:13515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.991238:0:13515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f1b expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.991254:0:13515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f1b expref: 61 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388103.991269:0:13515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945720576:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388103.991479:0:13515:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787388103.995524:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388103.995621:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925718272 00000100:00100000:0.0:1787388103.995634:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925718272 00010000:00010000:0.0:1787388103.995684:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f1b expref: 62 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388103.995737:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:0.0:1787388103.995746:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+62:2402:x1874211925718272:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388103.995765:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388103.995773:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f1b expref: 62 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.995787:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f1b expref: 62 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.995844:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:0.0:1787388103.995850:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.995861:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.995870:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388103.995894:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388103.996048:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474cdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f1b expref: 62 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388103.996075:0:13515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945720576:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388103.996100:0:13515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.996114:0:13515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.996120:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388103.996142:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787388103.996320:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f30 expref: 63 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.996337:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f30 expref: 62 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388103.996343:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:2.0:1787388103.996368:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787388103.996371:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5ce00, rc 0) 00000100:00100000:0.0:1787388103.997606:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+62:2402:x1874211925718272:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 1846us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388103.997622:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:2.0:1787388103.997723:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+61:11421:x1874211925718016:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 6759us (11431us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787388103.997731:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:3.0:1787388104.000593:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388104.000783:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925718528 00000100:00100000:1.0:1787388104.000797:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925718528 00000100:00100000:1.0:1787388104.000911:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:1.0:1787388104.000925:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+61:11421:x1874211925718528:12345-192.168.203.15@tcp:103:lfs.0 00010000:00010000:1.0:1787388104.000953:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388104.000986:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474c68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7eff expref: 61 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.001007:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388104.001012:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388104.001081:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+60:11421:x1874211925718528:12345-192.168.203.15@tcp:103:lfs.0 Request processed in 159us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.001090:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00080000:2.0:1787388104.002983:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388104.003567:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.003663:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925718656 00000100:00100000:2.0:1787388104.003675:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925718656 00000100:00100000:2.0:1787388104.003847:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 122 00000100:00100000:2.0:1787388104.003876:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+60:11421:x1874211925718656:12345-192.168.203.15@tcp:58:lfs.0 00010000:00010000:2.0:1787388104.004034:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.004058:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.004072:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388104.004215:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787388104.004320:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+60:11421:x1874211925718656:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 445us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388104.004330:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 122 00000100:00100000:0.0:1787388104.010702:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.011100:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925718784 00000100:00100000:3.0:1787388104.011121:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925718784 00000100:00100000:3.0:1787388104.011200:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 123 00000100:00100000:3.0:1787388104.011211:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+60:11421:x1874211925718784:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388104.011239:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388104.011264:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474d2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.011336:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.011377:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474d2c lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f37 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.011403:0:6520:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.011418:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474d2c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f37 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.011433:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:3.0:1787388104.011436:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388104.011451:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474d2c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f37 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.011460:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6000, rc 0) 00000100:00100000:3.0:1787388104.011531:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+61:11421:x1874211925718784:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 322us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.011539:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 123 00000040:00080000:1.0:1787388104.112708:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388104.112723:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388104.112799:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787388104.112812:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787388104.113006:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945720704:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787388104.113161:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b452cc480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388104.121953:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.122069:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925718912 00000100:00100000:2.0:1787388104.122083:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925718912 00000100:00100000:2.0:1787388104.122169:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:2.0:1787388104.122182:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+62:11422:x1874211925718912:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787388104.122229:0:13515:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787388104.122451:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+62:11422:x1874211925718912:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 272us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388104.122460:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:1.0:1787388104.123990:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945720704:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787388104.127881:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.128304:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925719040 00000100:00100000:3.0:1787388104.128317:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925719040 00000100:00100000:1.0:1787388104.130583:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:1.0:1787388104.130964:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+61:11422:x1874211925719040:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787388104.131079:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474d33 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131337:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474d33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131524:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474d33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131546:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d3a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131555:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131561:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131591:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131600:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131606:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388104.131672:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787388104.131677:0:10197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388104.131693:0:10197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131706:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474d33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131894:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474d33 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131901:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474d33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131907:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fa00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388104.131913:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474d33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131921:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474d33 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131944:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:1.0:1787388104.131947:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388104.131953:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474d33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131959:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474d33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131976:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131983:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d3a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131988:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.131993:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388104.132002:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.132008:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d3a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.132016:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff996b73adf800) 00010000:00010000:1.0:1787388104.132018:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388104.132021:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d3a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.132026:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474d3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.132040:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.132045:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.132050:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.132054:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4ee00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388104.132057:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.132062:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.132069:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388104.132071:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388104.132081:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.132086:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388104.132487:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+61:11422:x1874211925719040:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 1883us (4613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.132500:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:0.0:1787388104.136898:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.137525:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925719296 00000100:00100000:2.0:1787388104.137541:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925719296 00000100:00100000:2.0:1787388104.137612:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:2.0:1787388104.137624:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+61:11422:x1874211925719296:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388104.137653:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388104.137696:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d48 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f3e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138089:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138165:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138183:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388104.138196:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787388104.138307:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138315:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138321:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138327:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.138331:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138339:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138494:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:2.0:1787388104.138498:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787388104.138504:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138526:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138582:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d48 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f3e expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138595:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:2.0:1787388104.138597:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388104.138602:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d48 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f3e expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.138611:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5dc00, rc 0) 00000100:00100000:2.0:1787388104.138831:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+62:11422:x1874211925719296:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1207us (1944us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787388104.138840:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:0.0:1787388104.143057:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.143286:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925719424 00000100:00100000:3.0:1787388104.143299:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925719424 00000100:00100000:3.0:1787388104.143541:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:3.0:1787388104.143553:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+62:11422:x1874211925719424:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787388104.143603:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787388104.143774:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+62:11422:x1874211925719424:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 223us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.143784:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:0.0:1787388104.152674:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.153540:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925719680 00000100:00100000:2.0:1787388104.153556:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925719680 00000100:00100000:2.0:1787388104.153628:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 128 00000100:00100000:2.0:1787388104.153641:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+62:11422:x1874211925719680:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388104.153668:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388104.153672:0:10197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787388104.153705:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474ced lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f22 expref: 62 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.153849:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388104.153856:0:10197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388104.153899:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d5d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f45 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388104.154637:0:10197:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787388104.155326:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474d64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.155385:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474d64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.155399:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474d64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.155471:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f45 expref: 64 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.155489:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474d64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f45 expref: 63 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.155498:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b43bd1f00) 00010000:00010000:2.0:1787388104.155501:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388104.155505:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5de00, rc 0) 00000100:00100000:2.0:1787388104.155744:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+63:11422:x1874211925719680:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 2103us (3081us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787388104.155825:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 128 00000100:00100000:0.0:1787388104.161466:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.161567:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925719936 00000100:00100000:2.0:1787388104.161580:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925719936 00000100:00100000:2.0:1787388104.161695:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 129 00000100:00100000:2.0:1787388104.161718:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+63:11422:x1874211925719936:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388104.162481:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388104.162525:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474d64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f45 expref: 63 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162550:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b43bd1f00) 00010000:00010000:2.0:1787388104.162566:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388104.162594:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d72 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162610:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162622:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162638:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xc3ee0b0e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162645:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc3ee0b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162651:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc3ee0b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162726:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162733:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d72 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162740:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d72 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162874:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5dc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.162879:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d72 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162887:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d72 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162897:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388104.162900:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388104.162905:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d72 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162911:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4474d72 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162922:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc3ee0b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162928:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d79 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc3ee0b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162945:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc3ee0b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162950:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.162953:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc3ee0b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162959:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d79 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc3ee0b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162980:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xc3ee0b0e (ffff996b43bd1e00) 00010000:00010000:2.0:1787388104.162982:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388104.162985:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d79 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc3ee0b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.162992:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d79 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc3ee0b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388104.163485:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+62:11422:x1874211925719936:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 1775us (2151us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787388104.163496:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 129 00000100:00100000:0.0:1787388104.167278:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.167483:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925720064 00000100:00100000:3.0:1787388104.167496:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925720064 00000100:00100000:3.0:1787388104.167566:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 130 00000100:00100000:3.0:1787388104.167577:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+62:11422:x1874211925720064:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388104.167605:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388104.167634:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474d80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f4c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.167679:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.167986:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.168002:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.168282:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4474d80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f4c expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.168304:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f4c expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.168313:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:3.0:1787388104.168316:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787388104.168320:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6e00, rc 0) 00000100:00100000:3.0:1787388104.168479:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+63:11422:x1874211925720064:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 903us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.168488:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 130 00000100:00100000:0.0:1787388104.172767:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.172919:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925720320 00000100:00100000:2.0:1787388104.172941:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925720320 00000100:00100000:2.0:1787388104.173014:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:2.0:1787388104.173025:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+63:11422:x1874211925720320:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388104.173142:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.173161:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.173174:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388104.173407:0:10197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787388104.173418:0:10197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425696070870ns, next at 426696067507ns, rc = 0 00000004:00010000:2.0:1787388104.173474:0:10197:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063627cd6 reply state 000000002b67238b transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.173510:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.173519:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:2.0:1787388104.173522:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787388104.173526:0:10197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388104.173638:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+65:11422:x1874211925720320:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 613us (890us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787388104.173647:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:0.0:1787388104.179989:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.180172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925720448 00000100:00100000:2.0:1787388104.180186:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925720448 00000100:00100000:2.0:1787388104.180341:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:2.0:1787388104.180374:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+65:11422:x1874211925720448:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388104.180407:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388104.180433:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f53 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.180507:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f53 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.180524:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f53 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.180546:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:2.0:1787388104.180550:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787388104.180554:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c200, rc 0) 00000100:00100000:2.0:1787388104.180643:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+66:11422:x1874211925720448:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 271us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388104.180667:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:3.0:1787388104.184834:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388104.185097:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925720576 00000100:00100000:1.0:1787388104.185118:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925720576 00000100:00100000:1.0:1787388104.185195:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:1.0:1787388104.185208:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925720576:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787388104.185535:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+9:2402:x1874211925720576:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 328us (715us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787388104.185545:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:3.0:1787388104.189508:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388104.189652:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925720832 00000100:00100000:0.0:1787388104.189666:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925720832 00000100:00100000:0.0:1787388104.189739:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:0.0:1787388104.189830:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+66:11422:x1874211925720832:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787388104.190276:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+67:11422:x1874211925720832:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 523us (775us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1787388104.190285:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:0.0:1787388104.193541:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.193640:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925721088 00000100:00100000:3.0:1787388104.193652:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925721088 00000100:00100000:3.0:1787388104.193736:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:3.0:1787388104.193872:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+67:11422:x1874211925721088:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787388104.194031:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+67:11422:x1874211925721088:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 284us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.194040:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:0.0:1787388104.200019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388104.200462:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925721216 00000100:00100000:1.0:1787388104.200476:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925721216 00000100:00100000:1.0:1787388104.200548:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:1.0:1787388104.200560:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+67:11422:x1874211925721216:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388104.200587:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388104.200612:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.200695:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474da3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.200726:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.200760:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388104.200821:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388104.200845:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.200877:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474d9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f5a expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.200898:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f5a expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.200907:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:1.0:1787388104.200910:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787388104.200914:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e800, rc 0) 00000100:00100000:1.0:1787388104.201022:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+68:11422:x1874211925721216:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 463us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.201029:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:2.0:1787388104.204524:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.204749:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925721344 00000100:00100000:3.0:1787388104.204761:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925721344 00000100:00100000:3.0:1787388104.204865:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:3.0:1787388104.204876:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+9:2402:x1874211925721344:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388104.204900:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388104.204943:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1e79dd3/0x26817551a4474daa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f61 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388104.204978:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8960c8, blocks: 0x0 00010000:00010000:3.0:1787388104.205001:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1787388104.205007:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388104.205018:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e79dd3/0x26817551a4474daa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f61 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.205039:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f1e79dd3/0x26817551a4474daa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f61 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.205054:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7200, rc 0) 00000100:00100000:3.0:1787388104.205602:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+10:2402:x1874211925721344:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 725us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.205611:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:3.0:1787388104.218047:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.218305:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925721600 00000100:00100000:2.0:1787388104.218318:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925721600 00000100:00100000:2.0:1787388104.218433:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 135 00000100:00100000:2.0:1787388104.218445:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+68:11422:x1874211925721600:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787388104.218595:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+68:11422:x1874211925721600:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 152us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388104.218604:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 135 00000100:00100000:1.0:1787388104.222547:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.222795:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925721728 00000100:00100000:3.0:1787388104.222808:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925721728 00000100:00100000:3.0:1787388104.222879:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:3.0:1787388104.222889:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+10:11422:x1874211925721728:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388104.222929:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388104.222965:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f68 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.223007:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1e79dd3/0x26817551a4474daa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f61 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.223017:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388104.223021:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388104.223027:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.223089:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1e79dd3/0x26817551a4474daa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f61 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.223119:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1e79dd3/0x26817551a4474daa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f61 expref: 11 pid: 8436 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388104.223136:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874211945720832:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388104.223460:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388104.227299:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874211945720832:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388104.227428:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.227455:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6c00, rc 0) 00000100:00100000:1.0:1787388104.227520:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+11:11422:x1874211925721728:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 4631us (4986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.227552:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:0.0:1787388104.231670:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388104.231838:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925721856 00000100:00100000:1.0:1787388104.231851:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925721856 00010000:00010000:1.0:1787388104.231904:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e79dd3/0x26817551a4474daa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f61 expref: 11 pid: 8436 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388104.231972:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:1.0:1787388104.231984:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+11:2402:x1874211925721856:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388104.232003:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388104.232029:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1e79dd3/0x26817551a4474daa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f61 expref: 11 pid: 8436 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.232045:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1e79dd3/0x26817551a4474daa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f61 expref: 11 pid: 8436 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.232076:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1e79dd3/0x26817551a4474daa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f61 expref: 11 pid: 8436 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.232429:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388104.232434:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388104.232445:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.232455:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.232528:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388104.232547:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1874211945720960:192.168.203.15@tcp:105: 00000100:00100000:1.0:1787388104.232654:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b452cc480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388104.244976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.245341:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925721984 00000100:00100000:2.0:1787388104.245392:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925721984 00002000:00100000:2.0:1787388104.245459:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff996b7f6a3100 x1874211925721984/t0(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:360/0 lens 504/0 e 0 to 0 dl 1787388115 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787388104.245474:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b7f6a3100 with x1874211925721984 ext(0->12) 00002000:00010000:2.0:1787388104.245480:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b7f6a3100 00000100:00100000:2.0:1787388104.245538:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:2.0:1787388104.245549:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+11:2401:x1874211925721984:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787388104.247331:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1874211945720960:192.168.203.15@tcp:105: 00010000:00010000:1.0:1787388104.247380:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388104.247511:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+13:2402:x1874211925721856:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 15527us (15853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.247524:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:2.0:1787388104.249250:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+12:2401:x1874211925721984:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 Request processed in 3690us (4275us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787388104.249266:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00002000:00100000:2.0:1787388104.249281:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff996b7f6a3100 x1874211925721984/t4294967309(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:360/0 lens 504/448 e 0 to 0 dl 1787388115 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787388104.249294:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b7f6a3100 with x1874211925721984 ext(0->12) 00002000:00010000:2.0:1787388104.249321:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b7f6a3100 00000100:00100000:3.0:1787388104.256284:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388104.256810:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925722112 00000100:00100000:0.0:1787388104.256823:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925722112 00000100:00100000:0.0:1787388104.256907:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:0.0:1787388104.256919:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+68:11422:x1874211925722112:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787388104.269659:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1787388104.269680:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1787388104.269711:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787388104.269743:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996b47f21600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787388104.269748:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b7292c900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996b45304300 00000020:00080000:3.0:1787388104.269765:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b7292c200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996b7ac22400 00000004:00080000:3.0:1787388104.269790:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787388104.269810:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996b7bde93c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787388104.269813:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b43200200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996b42e97c00 00000020:00080000:3.0:1787388104.269815:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b43200f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996b739ac200 00000020:00080000:3.0:1787388104.269841:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787388104.269900:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787388104.270033:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+22:11422:x1874211925722112:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 13111us (13759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.270043:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:1.0:1787388104.270386:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388104.270404:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945721088:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787388104.270452:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388104.270497:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945721088 00000100:00100000:1.0:1787388104.270503:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945721088 00000100:00100000:1.0:1787388104.270538:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787388104.270547:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3651:x1874211945721088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787388104.270567:0:8490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:1.0:1787388104.270599:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8960c7, atime: 0x6a8960c7, ctime: 0x6a8960c7, blocks: 0x8 00010000:00010000:1.0:1787388104.270606:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1a24576/0x26817551a4474db8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.270623:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1787388104.270627:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388104.270640:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1a24576/0x26817551a4474db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.270654:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1a24576/0x26817551a4474db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.270664:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1a24576/0x26817551a4474db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.270671:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1a24576/0x26817551a4474db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.270687:0:8490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787388104.270813:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3651:x1874211945721088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 266us (360us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787388104.270820:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1787388104.270837:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388104.270843:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1a24576/0x26817551a4474db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.270851:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4ee00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388104.270856:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1a24576/0x26817551a4474db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.270866:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1a24576/0x26817551a4474db8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.270895:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1a24576/0x26817551a4474db8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.270903:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1a24576/0x26817551a4474db8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.270921:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388104.270923:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388104.270925:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787388104.271178:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996b52efaa00/2, rc 0, transno 4294967305 00000100:00100000:1.0:1787388104.271184:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945721088:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787388104.271436:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271446:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271453:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271459:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.271463:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271468:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271480:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff996b728f5800) 00010000:00010000:2.0:1787388104.271483:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388104.271487:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271493:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474ab6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271514:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271521:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271526:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271542:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.271545:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271550:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271560:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff996b43bd1200) 00010000:00010000:2.0:1787388104.271562:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388104.271564:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271570:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4474b5e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271587:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271594:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271599:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271603:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.271605:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271611:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271629:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b74d22f00) 00010000:00010000:2.0:1787388104.271631:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388104.271634:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271640:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474bdc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271651:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271656:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271662:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271666:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5cc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.271668:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271673:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271679:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b74d22f00) 00010000:00010000:2.0:1787388104.271681:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388104.271683:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271688:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474bff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271710:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271716:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271722:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271727:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.271741:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271747:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271755:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:2.0:1787388104.271757:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388104.271761:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271766:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4474cd1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271778:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271784:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271789:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271800:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5ca00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.271803:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271807:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271815:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:2.0:1787388104.271817:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787388104.271820:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.271825:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4474d8e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388104.272677:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945721216:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787388104.272824:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.272915:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945721344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787388104.273451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388104.275766:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388104.275875:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945721216 00000100:00100000:0.0:1787388104.275885:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945721216 00000100:00100000:0.0:1787388104.275997:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945721344 00000100:00100000:0.0:1787388104.276001:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945721344 00000100:00100000:0.0:1787388104.276027:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787388104.276037:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1874211945721216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787388104.276067:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1787388104.276092:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.276113:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000687a906d/0x26817551a4474b6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec0 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.276122:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787388104.276125:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388104.276143:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.276180:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000687a906d/0x26817551a4474b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec0 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.276194:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000687a906d/0x26817551a4474b6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec0 expref: 11 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388104.276208:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f6a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211945721472:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388104.277342:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f21b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388104.277388:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787388104.277404:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1874211945721344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787388104.277525:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787388104.277528:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787388104 00002000:00010000:0.0:1787388104.277531:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787388104.277533:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787388104 -> 1787388104 00002000:00010000:0.0:1787388104.277535:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787388104.277596:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1874211945721344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (4145us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787388104.277603:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1787388104.277654:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996b7f6a3480/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787388104.277660:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f6a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945721344:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1787388104.278153:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787388104.278411:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1787388104.278422:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787388104.278708:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925722240 00000100:00100000:0.0:1787388104.278716:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925722240 00000100:00100000:0.0:1787388104.278848:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:0.0:1787388104.278872:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+12:2402:x1874211925722240:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787388104.280205:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787388104.280215:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1787388104.283513:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.283551:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925722368 00000100:00100000:3.0:1787388104.283559:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925722368 00010000:00010000:3.0:1787388104.283642:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000687a906d/0x26817551a4474b6c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec0 expref: 8 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388104.283679:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 74 00000100:00100000:3.0:1787388104.283688:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925722368:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388104.283701:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388104.283707:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000687a906d/0x26817551a4474b6c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec0 expref: 8 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388104.283857:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f6a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211945721472:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388104.283898:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000687a906d/0x26817551a4474b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec0 expref: 8 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.284972:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.285037:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000687a906d/0x26817551a4474b6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ec0 expref: 8 pid: 8437 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.285052:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388104.285056:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388104.285061:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.285070:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.285104:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388104.285213:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.285222:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.285231:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.285248:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.285278:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787388104.285484:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925722368:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 1795us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.285493:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 74 00010000:00010000:0.0:1787388104.289785:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388104.289800:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.289814:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388104.289819:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.289831:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.289851:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.289858:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008df024b6/0x26817551a4474dbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.289886:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388104.289888:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388104.289890:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388104.290700:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945721216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14659us (17870us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787388104.290711:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787388104.291040:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925722240:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 12168us (15280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.291048:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:3.0:1787388104.291581:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787388104.291588:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1787388104.291607:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996b7f6a3480, transno 4294967310 00000100:00100000:3.0:1787388104.291628:0:3649:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff996b7f6a1880 x1874211945721216/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787388120 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787388104.291640:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996b7f6a1880/2, rc 0, transno 4294967311 00000100:00100000:3.0:1787388104.291646:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f6a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945721216:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787388104.301069:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388104.307171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388104.307279:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925722624 00000100:00100000:0.0:1787388104.307289:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925722624 00000100:00100000:0.0:1787388104.307391:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:0.0:1787388104.307402:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+16:11422:x1874211925722624:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787388104.307456:0:13515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388104.307497:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474da3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f5a expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.307515:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:0.0:1787388104.307519:0:13515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388104.307548:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.307561:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.307570:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388104.307685:0:13515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046ed8b7c reply state 000000004969168e transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.307698:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.307704:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:0.0:1787388104.307706:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388104.307709:0:13515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787388104.307813:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+17:11422:x1874211925722624:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 412us (651us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1787388104.307821:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:0.0:1787388104.311563:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.311652:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925722752 00000100:00100000:3.0:1787388104.311662:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925722752 00000100:00100000:3.0:1787388104.311717:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:3.0:1787388104.311729:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925722752:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787388104.311889:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787388104.311893:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787388104 -> 1787388104 00002000:00010000:3.0:1787388104.311895:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787388103 00002000:00010000:3.0:1787388104.311897:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787388104 -> 1787388104 00002000:00010000:3.0:1787388104.311899:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787388104.311969:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:2401:x1874211925722752:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 241us (413us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787388104.311976:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:1.0:1787388104.317023:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.317121:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925723008 00000100:00100000:2.0:1787388104.317130:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925723008 00000100:00100000:2.0:1787388104.317189:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 138 00000100:00100000:2.0:1787388104.317198:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+17:11422:x1874211925723008:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787388104.317275:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.317292:0:10197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f4c expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.317317:0:10197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.317663:0:10197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f4c expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.317678:0:10197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f4c expref: 17 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388104.317692:0:10197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945721600:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388104.317777:0:10197:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388104.323973:0:10197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945721600:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388104.324003:0:10197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388104.325688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388104.325853:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925723136 00000100:00100000:0.0:1787388104.325862:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925723136 00010000:00010000:0.0:1787388104.325901:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f4c expref: 18 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388104.325969:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00100000:0.0:1787388104.325979:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:2402:x1874211925723136:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388104.325992:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388104.325999:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f4c expref: 18 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.326011:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f4c expref: 18 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.326034:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4474d87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f4c expref: 18 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.326049:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:0.0:1787388104.326053:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.326062:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.326069:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.326098:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388104.326153:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+17:2402:x1874211925723136:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 175us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388104.326161:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 75 00010000:00010000:2.0:1787388104.326413:0:10197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.326422:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.326462:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.326469:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.326476:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.326490:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5cc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.326494:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.326501:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.326510:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:2.0:1787388104.326512:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787388104.326516:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.326522:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4474dcd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388104.326573:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+16:11422:x1874211925723008:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 Request processed in 9375us (9557us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787388104.326581:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 138 00000100:00100000:1.0:1787388104.334443:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388104.334592:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925723264 00000100:00100000:0.0:1787388104.334615:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925723264 00000100:00100000:0.0:1787388104.334659:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:0.0:1787388104.334669:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2401:x1874211925723264:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787388104.334712:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.334745:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.334754:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388104.334758:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388104.334762:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.334796:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.334810:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 7 pid: 8434 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388104.334826:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f6a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211945721728:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388104.334906:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388104.337765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.337857:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925723392 00000100:00100000:2.0:1787388104.337865:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925723392 00010000:00010000:2.0:1787388104.337903:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 8 pid: 8434 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388104.337951:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:2.0:1787388104.337960:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925723392:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388104.337974:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388104.337996:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 8 pid: 8434 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.338028:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 8 pid: 8434 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.338053:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388104.338057:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388104.338063:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.338072:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.338091:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388104.338148:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925723392:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 189us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388104.338156:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 76 00010000:00010000:0.0:1787388104.338533:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c7dac0/0x26817551a4474db1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f68 expref: 7 pid: 8434 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388104.338549:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f6a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874211945721728:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388104.338576:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.338587:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.338594:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.338614:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.338623:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.338631:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.338637:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388104.338642:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.338649:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.338662:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.338675:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079142457/0x26817551a4474dd4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388104.338742:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925723264:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 4074us (4308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388104.338750:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:3.0:1787388104.343631:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388104.343741:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925723648 00000100:00100000:0.0:1787388104.343751:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925723648 00000100:00100000:0.0:1787388104.343812:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 139 00000100:00100000:0.0:1787388104.343822:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+16:11422:x1874211925723648:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787388104.343899:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.343916:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f14 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.343925:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.343972:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f14 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.343985:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f14 expref: 16 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388104.344001:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945721856:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388104.344086:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47f210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388104.351263:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388104.351343:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945721856:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388104.351408:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388104.351434:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925723776 00000100:00100000:1.0:1787388104.351440:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925723776 00010000:00010000:1.0:1787388104.351478:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f14 expref: 17 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388104.351516:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:1.0:1787388104.351525:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+17:2402:x1874211925723776:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388104.351540:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388104.351546:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f14 expref: 17 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.351572:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f14 expref: 17 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.351598:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a4474cca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f14 expref: 17 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.351615:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388104.351622:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474d2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f37 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.351630:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.351637:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.351644:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.351671:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388104.351727:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+16:2402:x1874211925723776:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 202us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.351734:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 77 00010000:00010000:3.0:1787388104.352557:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.352568:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.352735:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.352748:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f53 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.352769:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.352800:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f53 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388104.352813:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f53 expref: 16 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388104.352826:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945721984:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388104.352895:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787388104.362337:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945721984:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388104.362406:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388104.371513:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388104.371765:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925723904 00000100:00100000:1.0:1787388104.371773:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925723904 00010000:00010000:1.0:1787388104.371812:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f53 expref: 17 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388104.371865:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:1.0:1787388104.371874:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+17:2401:x1874211925723904:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388104.371889:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388104.371895:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f53 expref: 17 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.371907:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f53 expref: 17 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.371940:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a4474d95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f53 expref: 17 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.371955:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:1.0:1787388104.371960:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.371968:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.371974:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.371995:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388104.372058:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+16:2401:x1874211925723904:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 184us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.372065:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 78 00010000:00010000:0.0:1787388104.374013:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.374038:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388104.374162:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1787388104.374299:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1787388104.374338:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1787388104.374462:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874211945722112:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787388104.374525:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388104.374557:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388104.378586:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945722112 00000100:00100000:3.0:1787388104.378600:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945722112 00000100:00100000:3.0:1787388104.378704:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787388104.378723:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1874211945722112:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787388104.378881:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1874211945722112:12345-0@lo:1000:mdt00_002.0 Request processed in 161us (4355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.378889:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787388104.378979:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874211945722112:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787388104.379160:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1787388104.379236:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874211945722240:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787388104.379309:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388104.383249:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388104.383969:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945722240 00000100:00100000:1.0:1787388104.383994:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945722240 00000100:00100000:1.0:1787388104.384158:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787388104.384170:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1874211945722240:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787388104.384586:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f6a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6522:x1874211945722240:12345-0@lo:1000:mdt00_002.0 Request processed in 418us (5276us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787388104.384593:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787388104.384691:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f6a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874211945722240:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787388104.384758:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384777:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384784:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384790:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388104.384795:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384803:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384817:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:0.0:1787388104.384820:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787388104.384824:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384830:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474de2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384854:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384860:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384865:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384869:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388104.384878:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384883:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384892:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:0.0:1787388104.384894:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787388104.384900:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474d2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f37 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384911:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474d2c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f37 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384919:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474d2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f37 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.384964:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474d2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f37 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388104.384980:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a88700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945722368:192.168.203.15@tcp:105: 00000100:00100000:0.0:1787388104.385075:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a4235a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388104.399247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.399381:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925724032 00000100:00100000:3.0:1787388104.399391:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925724032 00000100:00100000:3.0:1787388104.399441:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:3.0:1787388104.399451:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+20:11421:x1874211925724032:12345-192.168.203.15@tcp:49:lfs.0 00000100:00100000:3.0:1787388104.399568:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+20:11421:x1874211925724032:12345-192.168.203.15@tcp:49:lfs.0 Request processed in 118us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388104.399576:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:2.0:1787388104.399924:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a88700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945722368:192.168.203.15@tcp:105: 00010000:00010000:2.0:1787388104.399962:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.399973:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474d25 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400004:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474de9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400032:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474de9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400051:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474de9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400065:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474de9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400071:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474de9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400077:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474de9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400083:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5de00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.400087:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474de9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400094:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474de9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400105:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:2.0:1787388104.400112:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388104.400116:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474de9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400122:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474de9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400132:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400138:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400149:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400155:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.400158:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400163:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400171:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:2.0:1787388104.400173:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787388104.400175:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.400181:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474ddb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388104.400310:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+19:11422:x1874211925723648:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 56488us (56687us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787388104.400319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 139 00000020:00080000:2.0:1787388104.400323:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787388104.400876:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388104.400882:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388104.401320:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787388104.401330:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787388104.406508:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388104.406548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388104.406654:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925724288 00000100:00100000:3.0:1787388104.406664:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925724288 00000100:00100000:3.0:1787388104.406724:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:3.0:1787388104.406883:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dcc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+19:11422:x1874211925724288:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787388104.407724:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925724544 00000100:00100000:1.0:1787388104.407738:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925724544 00000100:00100000:1.0:1787388104.407787:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 140 00000100:00100000:1.0:1787388104.407796:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+20:11421:x1874211925724544:12345-192.168.203.15@tcp:58:lfs.0 00000040:00080000:1.0:1787388104.407918:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787388104.408004:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+20:11421:x1874211925724544:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 209us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.408011:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 140 00000004:00080000:2.0:1787388104.409523:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787388104.409556:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1787388104.409592:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.409608:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.409636:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.409645:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.409651:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.409660:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.409792:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787388104.409887:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dcc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+21:11422:x1874211925724288:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 3151us (3384us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787388104.409895:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 32 00000020:00080000:2.0:1787388104.409900:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787388104.413380:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388104.413398:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.413409:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5de00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388104.413431:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.413440:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.413457:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:0.0:1787388104.413460:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787388104.413464:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.413470:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474df0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388104.413487:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388104.413489:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388104.413491:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388104.477291:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388104.477658:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925724672 00000100:00100000:2.0:1787388104.477669:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925724672 00000100:00100000:2.0:1787388104.477729:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:2.0:1787388104.477739:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+21:11424:x1874211925724672:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388104.477761:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388104.477793:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474df7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f6f expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.477866:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474dfe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.478602:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474dfe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.478711:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474dfe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.478733:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474e05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.478741:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474e05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.478748:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474e05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.478825:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.478838:0:10197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f30 expref: 22 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.478991:0:10197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.479033:0:10197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f30 expref: 22 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.479048:0:10197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f30 expref: 22 pid: 13515 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388104.479064:0:10197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945722496:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388104.479695:0:10197:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1787388104.497585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388104.497727:0:10197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945722496:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388104.497753:0:10197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388104.500575:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925724928 00000100:00100000:0.0:1787388104.500588:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925724928 00000100:00100000:1.0:1787388104.501482:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:1.0:1787388104.501494:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+23:10803:x1874211925724928:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787388104.502270:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+24:10803:x1874211925724928:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 767us (4683us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787388104.502279:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:2.0:1787388104.511687:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388104.520239:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925725056 00000100:00100000:1.0:1787388104.520256:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925725056 00010000:00010000:1.0:1787388104.520308:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f30 expref: 24 pid: 13515 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388104.520385:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:1.0:1787388104.520396:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+24:2401:x1874211925725056:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388104.520411:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388104.520418:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f30 expref: 24 pid: 13515 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.520432:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f30 expref: 24 pid: 13515 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.520455:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474d17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f30 expref: 24 pid: 13515 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.520473:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388104.520477:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.520486:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.520494:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388104.520519:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388104.520598:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+23:2401:x1874211925725056:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 203us (9349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388104.520605:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 79 00010000:00010000:2.0:1787388104.521659:0:10197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.521670:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388104.521733:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787388104.521738:0:10197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388104.521758:0:10197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.521771:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.521782:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474dfe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.521788:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474dfe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.521794:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474dfe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.521799:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.521803:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474dfe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.521810:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474dfe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.521821:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:2.0:1787388104.521835:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388104.521841:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474dfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522218:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474dfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522234:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474e05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522240:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474e05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522246:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474e05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522252:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388104.522255:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474e05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522261:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474e05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522269:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff996b4900c900) 00010000:00010000:2.0:1787388104.522271:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388104.522274:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474e05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522279:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474e05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522320:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474df7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f6f expref: 23 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522401:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f6f expref: 22 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388104.522409:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:2.0:1787388104.522412:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388104.522414:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d200, rc 0) 00000100:00100000:2.0:1787388104.522474:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+22:11424:x1874211925724672:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 44735us (45191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388104.522482:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:0.0:1787388104.940649:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388104.940674:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945722624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388104.940741:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388104.940874:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945722624 00000100:00100000:2.0:1787388104.940883:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945722624 00000100:00100000:2.0:1787388104.940946:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787388104.940956:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945722624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388104.940990:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388104.941040:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945722624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388104.941047:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787388104.941141:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945722624:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388105.324550:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388105.462507:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388105.462520:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388105.462544:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787388105.462550:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787388105.465844:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945722752:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787388105.465948:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517e8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787388105.471856:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945722752:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787388105.472688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388105.473031:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925725184 00000100:00100000:0.0:1787388105.473040:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925725184 00000100:00100000:0.0:1787388105.473104:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:0.0:1787388105.473114:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+22:11435:x1874211925725184:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787388105.473147:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787388105.473284:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+22:11435:x1874211925725184:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 171us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388105.473293:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:2.0:1787388105.484957:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388105.487306:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925725440 00000100:00100000:1.0:1787388105.487320:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925725440 00000100:00100000:1.0:1787388105.487434:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:1.0:1787388105.487446:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+22:11435:x1874211925725440:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388105.487466:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388105.487487:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474e13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f76 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.487592:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a4474e1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.487606:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a4474e1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.487617:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a4474e1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388105.487628:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787388105.488428:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474e13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f76 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.488445:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a4474e1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f76 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.488469:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388105.488472:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388105.488475:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ea00, rc 0) 00000100:00100000:1.0:1787388105.488537:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+24:11435:x1874211925725440:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1093us (3587us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787388105.488545:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:2.0:1787388105.495712:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388105.495826:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925725568 00000100:00100000:3.0:1787388105.495835:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925725568 00000100:00100000:3.0:1787388105.495899:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:3.0:1787388105.495910:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+24:2399:x1874211925725568:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388105.495935:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388105.495962:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a4474e1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f76 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388105.495979:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:3.0:1787388105.495984:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388105.496034:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+23:2399:x1874211925725568:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 125us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388105.496043:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:3.0:1787388105.503832:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388105.503950:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925725824 00000100:00100000:1.0:1787388105.503960:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925725824 00000100:00100000:1.0:1787388105.504019:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 144 00000100:00100000:1.0:1787388105.504029:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+23:11435:x1874211925725824:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787388105.504117:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474e28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.504134:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474e28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.504145:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474e28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.504310:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474e28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.504318:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474e28 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.504324:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474e28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.504391:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388105.504396:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474e28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.504405:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474e28 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.504417:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388105.504419:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388105.504424:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474e28 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.504430:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4474e28 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388105.504538:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+24:11435:x1874211925725824:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 510us (715us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787388105.504547:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 144 00000040:00080000:2.0:1787388105.505062:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388105.505068:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388105.505481:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787388105.505490:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787388105.511595:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388105.511657:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925726080 00000100:00100000:0.0:1787388105.511668:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925726080 00000100:00100000:0.0:1787388105.511743:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:0.0:1787388105.511755:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+24:11435:x1874211925726080:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787388105.512008:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+25:11435:x1874211925726080:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 254us (421us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787388105.512016:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00000040:00080000:3.0:1787388105.610424:0:14265:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388105.610433:0:14265:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388105.610469:0:14265:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787388105.610476:0:14265:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787388105.797674:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388105.797819:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925726336 00000100:00100000:1.0:1787388105.797829:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925726336 00000100:00100000:1.0:1787388105.797893:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 145 00000100:00100000:1.0:1787388105.797903:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+25:11448:x1874211925726336:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388105.798103:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388105.798123:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474e2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f7d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.798220:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474e36 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.798246:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474e36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.798257:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474e36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388105.798268:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787388105.798404:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ee00/0x26817551a4474e2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f7d expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.798420:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474e36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f7d expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388105.798429:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388105.798431:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787388105.798434:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e200, rc 0) 00000100:00100000:1.0:1787388105.798491:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+27:11448:x1874211925726336:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 589us (826us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787388105.798498:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 145 00000100:00100000:1.0:1787388105.809576:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388105.809672:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925726464 00000100:00100000:2.0:1787388105.809690:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925726464 00000100:00100000:2.0:1787388105.809754:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 146 00000100:00100000:2.0:1787388105.809764:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+27:11448:x1874211925726464:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:2.0:1787388105.809824:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474e44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388105.809842:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474e44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388105.809862:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474e44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388105.809897:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474e44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388105.809904:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474e44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388105.809910:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474e44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388105.810150:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388105.810157:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474e44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388105.810166:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474e44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388105.810179:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:2.0:1787388105.810182:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388105.810187:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474e44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388105.810204:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c600/0x26817551a4474e44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388105.810285:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+27:11448:x1874211925726464:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 521us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388105.810293:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 146 00000100:00100000:0.0:1787388105.965329:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945722880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388105.965431:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388105.965679:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945722880 00000100:00100000:1.0:1787388105.965686:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945722880 00000100:00100000:1.0:1787388105.965759:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787388105.965770:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945722880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388105.965799:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787388105.965854:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945722880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388105.965889:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1787388105.966298:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388105.966596:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945723008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388105.966639:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388105.966729:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945722880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388105.968405:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945723008 00000100:00100000:1.0:1787388105.968418:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945723008 00000100:00100000:1.0:1787388105.968481:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787388105.968491:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7509d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1874211945723008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388105.968679:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787388105.968770:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7509d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1874211945723008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 279us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388105.968778:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787388105.969041:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945723008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388106.026902:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388106.027485:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925726592 00000100:00100000:1.0:1787388106.027497:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925726592 00000100:00100000:1.0:1787388106.027630:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:1.0:1787388106.027641:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925726592:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:1.0:1787388106.027659:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388106.027681:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1a24576/0x26817551a4474e4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f84 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388106.027720:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8960c8, atime: 0x6a8960c7, ctime: 0x6a8960c8, blocks: 0x8 00010000:00010000:1.0:1787388106.027741:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787388106.027746:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388106.027756:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1a24576/0x26817551a4474e4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f84 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388106.027775:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1a24576/0x26817551a4474e4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f84 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388106.027808:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ee00, rc 0) 00000100:00100000:1.0:1787388106.027884:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:2401:x1874211925726592:12345-192.168.203.15@tcp:101:cat.0 Request processed in 246us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388106.027892:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00080000:3.0:1787388106.030372:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388106.043137:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388106.044462:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925726720 00000100:00100000:3.0:1787388106.044474:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925726720 00002000:00100000:3.0:1787388106.044527:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff996b7f5e0e00 x1874211925726720/t0(0) o3->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:362/0 lens 488/0 e 0 to 0 dl 1787388117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787388106.044539:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b7f5e0e00 with x1874211925726720 ext(0->4095) 00002000:00010000:3.0:1787388106.044546:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b7f5e0e00 00000100:00100000:3.0:1787388106.044579:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:3.0:1787388106.044589:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2399:x1874211925726720:12345-192.168.203.15@tcp:3:cat.0 00000100:00100000:3.0:1787388106.046810:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2399:x1874211925726720:12345-192.168.203.15@tcp:3:cat.0 Request processed in 2211us (3670us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787388106.046823:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00002000:00100000:3.0:1787388106.046834:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff996b7f5e0e00 x1874211925726720/t0(0) o3->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:362/0 lens 488/4536 e 0 to 0 dl 1787388117 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787388106.046844:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b7f5e0e00 with x1874211925726720 ext(0->4095) 00002000:00010000:3.0:1787388106.046850:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b7f5e0e00 00010000:00010000:0.0:1787388106.350271:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388107.378922:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388108.012690:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945723136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388108.012763:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388108.013116:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945723136 00000100:00100000:2.0:1787388108.013124:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945723136 00000100:00100000:2.0:1787388108.013170:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787388108.013178:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945723136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388108.013208:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787388108.013247:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945723136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388108.013254:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787388108.013387:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945723136:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388108.396928:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787388108.588637:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388108.588646:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388108.588665:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787388108.588675:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787388108.910522:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787388109.036558:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945723264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388109.036631:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388109.036715:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945723264 00000100:00100000:1.0:1787388109.036723:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945723264 00000100:00100000:1.0:1787388109.036776:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787388109.036786:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945723264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787388109.036813:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388109.036854:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945723264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388109.036861:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1787388109.036881:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388109.036920:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787388109.036926:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1787388109.036946:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996a4404bb80, transno 4294967302 00000004:00080000:1.0:1787388109.036955:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1787388109.036966:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996b52efaa00, transno 4294967305 00000100:00100000:1.0:1787388109.036977:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945723264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388109.038132:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945723392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388109.038174:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.038273:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945723392 00000100:00100000:0.0:1787388109.038278:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945723392 00000100:00100000:0.0:1787388109.038321:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787388109.038329:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945723392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388109.038383:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388109.038421:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945723392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.038429:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1787388109.039200:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388109.039239:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945723392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388109.041568:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945723904:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.041680:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.041723:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b44948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945724416:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.041746:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.041771:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787388109.041776:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945723776:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.043088:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.043123:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b49a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945724288:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.043162:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.043185:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945724800:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.043202:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388109.043244:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945723904 00000100:00100000:0.0:1787388109.043251:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945723904 00000100:00100000:0.0:1787388109.043291:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945724288 00000100:00100000:0.0:1787388109.043293:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945724288 00000100:00100000:0.0:1787388109.043317:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945724800 00000100:00100000:0.0:1787388109.043319:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945724800 00000100:00100000:0.0:1787388109.043335:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787388109.043342:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945723904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.043406:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945723904:12345-0@lo:400:kworker.0 Request processed in 64us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.043413:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787388109.043440:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787388109.043445:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945724288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.043469:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945724288:12345-0@lo:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.043475:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787388109.043484:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787388109.043489:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945724800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.043509:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945724800:12345-0@lo:400:kworker.0 Request processed in 20us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.043515:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787388109.043531:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945724416 00000100:00100000:0.0:1787388109.043534:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945724416 00000100:00100000:0.0:1787388109.043561:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787388109.043568:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945724416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.043596:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945724416:12345-0@lo:400:kworker.0 Request processed in 28us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.043601:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1787388109.043624:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388109.043628:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787388109.043659:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b49a80a80 x1874211945724288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388109.043673:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b49a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945724288:0@lo:400:kworker.0 00010000:00080000:0.0:1787388109.043684:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43aff100 x1874211945724800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388109.043692:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945724800:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.043713:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945723904:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.043724:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b44948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945724416:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.044235:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945723520:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.044279:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388109.044318:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945724032:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.044343:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388109.044382:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945724544:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.044404:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388109.044427:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787388109.044434:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945723648:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.044455:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388109.044473:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b49a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945724160:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.044517:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388109.044535:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945724672:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.044554:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388109.044592:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945723776 00000100:00100000:2.0:1787388109.044597:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945723776 00000100:00100000:2.0:1787388109.044630:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945724032 00000100:00100000:2.0:1787388109.044633:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945724032 00000100:00100000:2.0:1787388109.044649:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787388109.044656:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945723776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.044697:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945723776:12345-0@lo:400:kworker.0 Request processed in 41us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.044704:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787388109.044722:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787388109.044728:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945724032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.044757:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945724032:12345-0@lo:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.044762:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787388109.044778:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945723648 00000100:00100000:2.0:1787388109.044782:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945723648 00000100:00100000:2.0:1787388109.044796:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945724160 00000100:00100000:2.0:1787388109.044799:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945724160 00000100:00100000:2.0:1787388109.044990:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787388109.044998:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945723648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.045028:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945723648:12345-0@lo:400:kworker.0 Request processed in 32us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.045033:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787388109.045044:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945724672 00000100:00100000:2.0:1787388109.045053:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945724672 00000100:00100000:2.0:1787388109.045070:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787388109.045076:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945724160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.045103:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945724160:12345-0@lo:400:kworker.0 Request processed in 27us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.045109:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787388109.045119:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787388109.045125:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945724672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.045150:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945724672:12345-0@lo:400:kworker.0 Request processed in 25us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.045155:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787388109.045177:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945724544 00000100:00100000:2.0:1787388109.045180:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945724544 00000100:00100000:2.0:1787388109.045204:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787388109.045210:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1874211945724544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.045235:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1874211945724544:12345-0@lo:400:kworker.0 Request processed in 26us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.045241:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787388109.045272:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945723648:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.045281:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b49a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945724160:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.045288:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945724672:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.045296:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945724032:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.045304:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945724544:0@lo:400:kworker.0 00000100:00080000:2.0:1787388109.045338:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388109.045374:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388109.045396:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945723776:0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.052084:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945723520 00000100:00100000:0.0:1787388109.052100:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945723520 00000100:00100000:0.0:1787388109.052151:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1787388109.052161:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945723520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388109.052254:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3649:x1874211945723520:12345-0@lo:400:kworker.0 Request processed in 94us (7973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.052262:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787388109.054235:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945723520:0@lo:400:kworker.0 00000100:00100000:2.0:1787388109.062595:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388109.062691:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388109.062721:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388109.062758:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925727232 00000100:00100000:1.0:1787388109.062767:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925727232 00000100:00100000:1.0:1787388109.062837:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:1.0:1787388109.062847:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+7:2400:x1874211925727232:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388109.062924:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+7:2400:x1874211925727232:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388109.062931:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00080000:1.0:1787388109.063063:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388109.070804:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388109.070848:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388109.072539:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925726848 00000100:00100000:3.0:1787388109.072550:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925726848 00000100:00100000:3.0:1787388109.072596:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 391 00000100:00100000:3.0:1787388109.072604:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925726848:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388109.072734:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925726848:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 71us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388109.072741:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 391 00000100:00100000:0.0:1787388109.073210:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925726976 00000100:00100000:0.0:1787388109.073216:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925726976 00000100:00100000:0.0:1787388109.073258:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925727488 00000100:00100000:0.0:1787388109.073260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925727488 00000100:00100000:0.0:1787388109.073279:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 326 00000100:00100000:0.0:1787388109.073285:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+27:2400:x1874211925726976:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388109.073317:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+27:2400:x1874211925726976:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 33us (10732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.073323:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 326 00000100:00100000:0.0:1787388109.073333:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 327 00000100:00100000:0.0:1787388109.073338:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925727488:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388109.073368:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925727488:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (10647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388109.073375:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 327 00000100:00100000:2.0:1787388109.074695:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388109.074718:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925727360 00000100:00100000:2.0:1787388109.074725:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925727360 00000100:00100000:2.0:1787388109.074766:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:2.0:1787388109.074775:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925727360:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388109.074835:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925727360:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.074843:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:2.0:1787388109.074882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388109.074975:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925727104 00000100:00100000:2.0:1787388109.075328:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925727104 00000100:00100000:2.0:1787388109.075380:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925727616 00000100:00100000:2.0:1787388109.075382:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925727616 00000100:00100000:2.0:1787388109.075400:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 328 00000100:00100000:2.0:1787388109.075406:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925727104:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388109.075628:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925727104:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 221us (4778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.075635:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 328 00000100:00100000:2.0:1787388109.075649:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 329 00000100:00100000:2.0:1787388109.075655:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925727616:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388109.075698:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925727616:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 44us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388109.075705:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 329 00000100:00080000:0.0:1787388109.083410:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388109.083420:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787388109.083431:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787388109.420580:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388110.061191:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388110.061224:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945724928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388110.061294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388110.061499:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945724928 00000100:00100000:1.0:1787388110.061508:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945724928 00000100:00100000:1.0:1787388110.061547:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787388110.061556:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b44948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945724928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787388110.061586:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787388110.061636:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b44948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945724928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388110.061643:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787388110.061781:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945724928:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787388110.449570:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787388110.575257:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1787388110.575271:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787388110.584717:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1787388110.584760:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996b517ce9c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787388110.584766:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b7292c000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996b517ceb40 00000020:00080000:1.0:1787388110.584769:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b7292c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996b612a1000 00000020:00080000:1.0:1787388110.584795:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:1.0:1787388110.585981:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388110.586006:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388110.586014:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388110.586021:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388110.586025:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388110.586033:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388110.586051:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff996b51436d00) 00010000:00010000:1.0:1787388110.586054:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388110.586069:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388110.586076:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4474dc6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787388110.590929:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787388110.591009:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1787388111.085231:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945725056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388111.085309:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388111.085571:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945725056 00000100:00100000:1.0:1787388111.085579:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945725056 00000100:00100000:1.0:1787388111.085650:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787388111.085661:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945725056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388111.085690:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787388111.085749:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945725056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388111.085756:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1787388111.085949:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388111.086030:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945725056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388111.086536:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945725184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388111.086578:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388111.086815:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945725184 00000100:00100000:1.0:1787388111.086821:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945725184 00000100:00100000:1.0:1787388111.086874:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787388111.086882:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945725184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388111.086910:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787388111.086959:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945725184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388111.086965:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1787388111.087050:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388111.087176:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1787388111.087182:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996b7f6a1880, transno 4294967311 00000004:00080000:3.0:1787388111.087198:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1787388111.087221:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945725184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388111.211081:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388111.211542:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925727744 00000100:00100000:0.0:1787388111.211553:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925727744 00000100:00100000:0.0:1787388111.211629:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 147 00000100:00100000:0.0:1787388111.211640:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+13:11108:x1874211925727744:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1787388111.211824:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388111.211892:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+13:11108:x1874211925727744:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 Request processed in 245us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388111.211900:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 147 00000100:00100000:3.0:1787388111.222266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388111.226160:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925727872 00000100:00100000:0.0:1787388111.226176:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925727872 00000100:00100000:0.0:1787388111.226274:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 148 00000100:00100000:0.0:1787388111.226287:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:11108:x1874211925727872:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787388111.226467:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:11108:x1874211925727872:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 Request processed in 183us (4211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388111.226475:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 148 00000100:00080000:1.0:1787388111.226629:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388111.230745:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388111.230850:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925728128 00000100:00100000:0.0:1787388111.230861:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925728128 00000100:00100000:0.0:1787388111.230934:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:0.0:1787388111.230944:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+13:11108:x1874211925728128:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787388111.231283:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+14:11108:x1874211925728128:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 340us (548us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787388111.231291:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 35 00010000:00010000:3.0:1787388111.468503:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388111.546259:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388111.546422:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925728256 00000100:00100000:1.0:1787388111.546432:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925728256 00000100:00100000:1.0:1787388111.546504:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 149 00000100:00100000:1.0:1787388111.546513:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:11906:x1874211925728256:12345-192.168.203.15@tcp:101:lsof.0 00010000:00010000:1.0:1787388111.546532:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388111.546594:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474e52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f8b expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.546657:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.546671:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.546683:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388111.546730:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388111.546733:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388111.546776:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.546823:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474e52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f8b expref: 7 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.546840:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f8b expref: 6 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388111.546848:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:1.0:1787388111.546851:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388111.546855:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f800, rc 0) 00000100:00100000:1.0:1787388111.546929:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:11906:x1874211925728256:12345-192.168.203.15@tcp:101:lsof.0 Request processed in 416us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388111.546936:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 149 00000100:00080000:0.0:1787388111.547302:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787388112.492730:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388113.138321:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945725312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388113.138424:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388113.138562:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945725312 00000100:00100000:2.0:1787388113.138570:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945725312 00000100:00100000:2.0:1787388113.138627:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787388113.138637:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945725312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388113.138679:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787388113.139101:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945725312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 464us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388113.139110:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787388113.139194:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945725312:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787388113.516510:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388114.156555:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388114.156579:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945725568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388114.156685:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388114.156757:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945725568 00000100:00100000:1.0:1787388114.156765:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945725568 00000100:00100000:1.0:1787388114.156843:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787388114.156855:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945725568:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787388114.156871:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787388114.156895:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388114.156950:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945725440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388114.156956:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945725568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.156965:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787388114.156988:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388114.157062:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945725440 00000100:00100000:2.0:1787388114.157066:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945725440 00000100:00100000:2.0:1787388114.157244:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787388114.157253:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945725440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388114.157265:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388114.157300:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945725440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.157320:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787388114.157401:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945725440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388114.157445:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945725568:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787388114.157604:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388114.157761:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945725696:0@lo:400:kworker.0 00000100:00100000:3.0:1787388114.157795:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.157861:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945725696 00000100:00100000:0.0:1787388114.157876:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945725696 00000100:00100000:0.0:1787388114.157915:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1787388114.157923:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945725696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.158082:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945726080:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.158131:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388114.158172:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945725824:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.158196:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388114.158215:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388114.158231:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945725952:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.158256:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388114.158287:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945726080 00000100:00100000:1.0:1787388114.158291:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945726080 00000100:00100000:1.0:1787388114.158315:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945725824 00000100:00100000:1.0:1787388114.158318:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945725824 00000100:00100000:1.0:1787388114.158333:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787388114.158338:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945726080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.158392:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945726080:12345-0@lo:400:kworker.0 Request processed in 53us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.158398:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787388114.158410:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787388114.158416:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945725824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.158444:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945725824:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.158451:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787388114.158476:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945726080:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.158500:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945725824:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.158529:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945725952 00000100:00100000:1.0:1787388114.158533:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945725952 00000100:00100000:1.0:1787388114.158567:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787388114.158573:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945725952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.158606:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945725952:12345-0@lo:400:kworker.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.158611:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787388114.158638:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945725952:0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.162526:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945725696:12345-0@lo:400:kworker.0 Request processed in 4595us (4721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.162547:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787388114.164950:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945725696:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.167966:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388114.168084:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945726464:0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.168123:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945726336:0@lo:400:kworker.0 00000100:00100000:3.0:1787388114.168160:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.168191:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.168238:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945726464 00000100:00100000:3.0:1787388114.168241:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945726336 00000100:00100000:0.0:1787388114.168245:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945726464 00000100:00100000:3.0:1787388114.168247:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945726336 00000100:00100000:1.0:1787388114.168283:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945726592:0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.168311:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787388114.168319:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.168325:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945726464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.168339:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945726848:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.168339:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945726208:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.168404:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388114.168405:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.168406:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945726464:12345-0@lo:400:kworker.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.168427:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388114.168427:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388114.168431:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787388114.168437:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945726976:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.168437:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a42d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945726720:0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.168461:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945726848 00000100:00100000:2.0:1787388114.168465:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388114.168465:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388114.168467:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945726848 00000100:00100000:2.0:1787388114.168491:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945726976 00000100:00100000:1.0:1787388114.168491:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945726592 00000100:00100000:2.0:1787388114.168496:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945726976 00000100:00100000:1.0:1787388114.168496:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945726592 00000100:00100000:3.0:1787388114.168741:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787388114.168764:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945726336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388114.168797:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945726336:12345-0@lo:400:kworker.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388114.168803:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00080000:3.0:1787388114.168833:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a42d9ad80 x1874211945726464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388114.169033:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945726464:0@lo:400:kworker.0 00000100:00100000:3.0:1787388114.169081:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945726208 00000100:00100000:3.0:1787388114.169085:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945726208 00000100:00100000:3.0:1787388114.169112:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787388114.169119:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945726208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388114.169157:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945726208:12345-0@lo:400:kworker.0 Request processed in 38us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388114.169163:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787388114.169197:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945726336:0@lo:400:kworker.0 00000100:00100000:3.0:1787388114.169226:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945726720 00000100:00100000:3.0:1787388114.169229:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945726720 00000100:00100000:3.0:1787388114.169287:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787388114.169294:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945726720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388114.169322:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945726720:12345-0@lo:400:kworker.0 Request processed in 30us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388114.169327:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1787388114.169377:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388114.169381:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388114.169383:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388114.169469:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945726720:0@lo:400:kworker.0 00000100:00100000:3.0:1787388114.169495:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945726208:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.172769:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787388114.172787:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945726592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.172909:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945726592:12345-0@lo:400:kworker.0 Request processed in 129us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.172917:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787388114.172973:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945726592:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.176654:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388114.176803:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787388114.176814:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945726976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388114.176897:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945726976:12345-0@lo:400:kworker.0 Request processed in 85us (8433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388114.176905:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00010000:00080000:2.0:1787388114.176955:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4404bb80 x1874211945726976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388114.176972:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945726976:0@lo:400:kworker.0 00000100:00100000:1.0:1787388114.178081:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388114.178124:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388114.178151:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388114.178171:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388114.178192:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388114.178218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388114.178246:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925728896 00000100:00100000:1.0:1787388114.178253:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925728896 00000100:00100000:1.0:1787388114.178300:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925728768 00000100:00100000:1.0:1787388114.178316:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925728768 00000100:00100000:1.0:1787388114.178343:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:1.0:1787388114.178370:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925728896:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388114.178427:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925728896:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 59us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.178434:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:1.0:1787388114.178649:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:1.0:1787388114.178656:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2400:x1874211925728768:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388114.178680:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2400:x1874211925728768:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.178686:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00080000:1.0:1787388114.178705:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388114.178710:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388114.178816:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925728640 00000100:00100000:1.0:1787388114.178821:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925728640 00000100:00100000:1.0:1787388114.178845:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925729152 00000100:00100000:1.0:1787388114.178848:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925729152 00000100:00100000:1.0:1787388114.178860:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925728512 00000100:00100000:1.0:1787388114.178873:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925728512 00000100:00100000:1.0:1787388114.178886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925729024 00000100:00100000:1.0:1787388114.178888:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925729024 00000100:00100000:1.0:1787388114.178901:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 335 00000100:00100000:1.0:1787388114.178906:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925728640:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388114.178941:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925728640:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 34us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.178947:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 335 00000100:00100000:1.0:1787388114.178960:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 336 00000100:00100000:1.0:1787388114.178973:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925729152:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388114.178998:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925729152:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.179005:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 336 00000100:00100000:1.0:1787388114.179016:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 337 00000100:00100000:1.0:1787388114.179022:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+14:2400:x1874211925728512:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388114.179049:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+14:2400:x1874211925728512:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.179055:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 337 00000100:00100000:1.0:1787388114.179065:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 338 00000100:00100000:1.0:1787388114.179071:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2400:x1874211925729024:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388114.179192:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2400:x1874211925729024:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 120us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388114.179200:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 338 00000100:00080000:1.0:1787388114.179215:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388114.179218:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388114.179367:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787388114.179376:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945726848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388114.179429:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945726848:12345-0@lo:400:kworker.0 Request processed in 54us (11026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388114.179435:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787388114.179490:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a42d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945726848:0@lo:400:kworker.0 00000100:00100000:3.0:1787388114.180678:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925728384 00000100:00100000:3.0:1787388114.180687:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925728384 00000100:00100000:3.0:1787388114.180736:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 393 00000100:00100000:3.0:1787388114.180744:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925728384:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388114.180795:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925728384:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 52us (4150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388114.180801:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 393 00010000:00010000:1.0:1787388114.547949:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388115.182069:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388115.182092:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945727104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388115.182173:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388115.182255:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945727104 00000100:00100000:2.0:1787388115.182263:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945727104 00000100:00100000:2.0:1787388115.182323:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787388115.182333:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945727104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388115.182411:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388115.182508:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945727104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 175us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388115.182530:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787388115.182545:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945727104:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787388115.564518:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787388115.634074:0:14462:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:41:54 (1787388114) 00000100:00100000:0.0:1787388116.204589:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945727232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388116.204677:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388116.206043:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945727232 00000100:00100000:2.0:1787388116.206055:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945727232 00000100:00100000:2.0:1787388116.206112:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787388116.206125:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945727232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787388116.206168:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:1.0:1787388116.206184:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388116.206298:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388116.206312:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945727360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388116.206363:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388116.206398:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945727360 00000100:00100000:3.0:1787388116.206402:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945727360 00000100:00100000:3.0:1787388116.206428:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787388116.206433:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945727360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388116.206443:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787388116.206473:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945727360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388116.206480:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787388116.206523:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945727360:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787388116.206545:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787388116.206787:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1787388116.206796:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787388116.206846:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787388116.206863:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787388116.207651:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945727232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1527us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388116.207661:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787388116.207774:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945727232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787388116.588578:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388117.093838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388117.094163:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925729408 00000100:00100000:3.0:1787388117.094172:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925729408 00000100:00100000:3.0:1787388117.094261:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 150 00000100:00100000:3.0:1787388117.094273:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+13:12173:x1874211925729408:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388117.094292:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388117.094311:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f92 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094422:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e67 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094437:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094447:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094520:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e6e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094529:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094536:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094702:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474e75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094711:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474e75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094719:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474e75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388117.094738:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787388117.094828:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094836:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e67 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094852:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094858:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388117.094863:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094871:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e67 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094883:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996b728f7300) 00010000:00010000:3.0:1787388117.094886:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388117.094890:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094896:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094908:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094915:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e6e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094931:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094940:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388117.094946:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094952:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e6e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094960:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff996b51436900) 00010000:00010000:3.0:1787388117.094962:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388117.094965:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e6e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.094975:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e6e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787388117.095304:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787388117.096568:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f92 expref: 16 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.096589:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474e75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f92 expref: 15 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388117.096598:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:3.0:1787388117.096601:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388117.096603:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6200, rc 0) 00000100:00100000:3.0:1787388117.097514:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+15:12173:x1874211925729408:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 3239us (3680us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787388117.097537:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 150 00000100:00100000:0.0:1787388117.107544:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388117.107740:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925729536 00000100:00100000:2.0:1787388117.107751:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925729536 00000100:00100000:2.0:1787388117.107818:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 151 00000100:00100000:2.0:1787388117.107828:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+15:12173:x1874211925729536:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787388117.107951:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+15:12173:x1874211925729536:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 124us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388117.107959:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 151 00000100:00100000:0.0:1787388117.109763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388117.110055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388117.110133:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925729792 00000100:00100000:2.0:1787388117.110141:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925729792 00000100:00100000:2.0:1787388117.110196:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 152 00000100:00100000:2.0:1787388117.110205:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:12173:x1874211925729792:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787388117.110286:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:12173:x1874211925729792:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 81us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388117.110293:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 152 00000100:00080000:3.0:1787388117.110376:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388117.111038:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925729664 00000100:00100000:1.0:1787388117.111044:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925729664 00000100:00100000:1.0:1787388117.111094:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:1.0:1787388117.111110:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+15:2399:x1874211925729664:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388117.111122:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388117.111145:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474e75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f92 expref: 15 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388117.111163:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:1.0:1787388117.111168:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388117.111195:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+14:2399:x1874211925729664:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 87us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388117.111201:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00010000:00010000:3.0:1787388117.612442:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388117.805262:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787388117.805271:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787388117.805809:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787388117.805818:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787388118.124982:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787388118.252538:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388118.252563:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945727488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388118.252716:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388118.259826:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945727488 00000100:00100000:3.0:1787388118.259853:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945727488 00000100:00100000:3.0:1787388118.259973:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787388118.259983:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945727488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388118.260030:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787388118.260128:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945727488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (7412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388118.260135:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787388118.260216:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945727488:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787388118.636933:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388118.832776:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787388118.832786:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787388118.832893:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787388118.832900:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787388118.973924:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388118.973994:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925729920 00000100:00100000:3.0:1787388118.974004:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925729920 00000100:00100000:3.0:1787388118.974065:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 153 00000100:00100000:3.0:1787388118.974076:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+14:12216:x1874211925729920:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388118.974096:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388118.974116:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7f99 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974178:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974193:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974203:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974228:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974237:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974244:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974284:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974291:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974297:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974303:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388118.974307:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974315:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974326:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:3.0:1787388118.974330:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388118.974334:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974339:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474e8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974379:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974385:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974391:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974395:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388118.974398:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974404:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974411:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff996b51436900) 00010000:00010000:3.0:1787388118.974414:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388118.974416:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974421:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474e91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974447:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f99 expref: 15 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974456:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:3.0:1787388118.974458:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388118.974466:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f99 expref: 15 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.974474:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7e00, rc 0) 00000100:00100000:3.0:1787388118.974531:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+14:12216:x1874211925729920:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 457us (616us total) trans 0 rc 301/301 00000100:00100000:3.0:1787388118.974538:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 153 00000100:00100000:1.0:1787388118.984426:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388118.984529:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925730176 00000100:00100000:0.0:1787388118.984541:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925730176 00000100:00100000:0.0:1787388118.984605:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 154 00000100:00100000:0.0:1787388118.984907:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+14:12216:x1874211925730176:12345-192.168.203.15@tcp:36:lfs.0 00010000:00010000:0.0:1787388118.984968:0:10197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388118.984996:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a44747d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dbd expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388118.985601:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:0.0:1787388118.985864:0:10197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388118.985928:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388118.985944:0:10197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f8b expref: 5 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388118.985952:0:10197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388118.985985:0:10197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f8b expref: 5 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388118.986068:0:10197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f8b expref: 5 pid: 13515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388118.986092:0:10197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b49a80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945727616:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388118.986198:0:10197:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a4235a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388118.988382:0:10197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b49a80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945727616:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388118.988412:0:10197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388118.989974:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388118.990454:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925730304 00000100:00100000:1.0:1787388118.990463:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925730304 00000100:00080000:3.0:1787388118.990529:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787388118.990947:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f8b expref: 6 pid: 13515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388118.990991:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00100000:1.0:1787388118.991003:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2401:x1874211925730304:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388118.992087:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388118.992104:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f8b expref: 6 pid: 13515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388118.992123:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f8b expref: 6 pid: 13515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388118.992161:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4474e59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f8b expref: 6 pid: 13515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388118.992176:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:1.0:1787388118.992182:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388118.992192:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388118.992199:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388118.992300:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388118.992391:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925730304:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 1390us (2421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388118.992401:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 80 00010000:00010000:3.0:1787388118.993232:0:10197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993245:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993271:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993293:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993304:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993896:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993915:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993922:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388118.993939:0:10197:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7ee94c0 reply state 00000000510a7c80 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993951:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993957:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388118.993960:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388118.993963:0:10197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787388118.993969:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787388118.993975:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993982:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993988:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.993994:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388118.993998:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.994005:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.994025:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d22400) 00010000:00010000:3.0:1787388118.994027:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388118.994031:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.994037:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474e98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388118.994055:0:10197:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7ee94c0 reply state 00000000510a7c80 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.994064:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388118.994070:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff996b51436900) 00010000:00010000:3.0:1787388118.994073:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388118.994075:0:10197:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787388118.994157:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+15:12216:x1874211925730176:12345-192.168.203.15@tcp:36:lfs.0 Request processed in 9251us (9738us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787388118.994165:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 154 00000100:00100000:3.0:1787388119.085775:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388119.085889:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925730432 00000100:00100000:0.0:1787388119.085899:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925730432 00000100:00100000:0.0:1787388119.085977:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 155 00000100:00100000:0.0:1787388119.085987:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+15:12224:x1874211925730432:12345-192.168.203.15@tcp:101:lctl.0 00010000:00010000:0.0:1787388119.086017:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388119.086040:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474ead lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fa0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.086104:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474eb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.086117:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.086127:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388119.086186:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787388119.086190:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388119.086208:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.086230:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474ead lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fa0 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.086248:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fa0 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.086270:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d0be00) 00010000:00010000:0.0:1787388119.086273:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388119.086276:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031400, rc 0) 00000100:00100000:0.0:1787388119.086339:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+16:12224:x1874211925730432:12345-192.168.203.15@tcp:101:lctl.0 Request processed in 353us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.086380:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 155 00000100:00080000:3.0:1787388119.086539:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388119.148635:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.148722:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925730560 00000100:00100000:3.0:1787388119.148734:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925730560 00000100:00100000:3.0:1787388119.148789:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 156 00000100:00100000:3.0:1787388119.148799:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+16:12230:x1874211925730560:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1787388119.148819:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388119.148847:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474ebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fa7 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.148930:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474ec2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.148943:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.148954:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.148963:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474ec9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.148970:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.148976:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149058:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a4474ed0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149066:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a4474ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149072:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a4474ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388119.149106:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787388119.149110:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388119.149130:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a4474ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149154:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149171:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474ec2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149179:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149185:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388119.149189:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149196:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474ec2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149208:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d0be00) 00010000:00010000:3.0:1787388119.149211:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388119.149215:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474ec2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149220:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474ec2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149233:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149239:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474ec9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149243:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149254:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388119.149257:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149263:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474ec9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149271:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff996b51436900) 00010000:00010000:3.0:1787388119.149273:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388119.149275:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474ec9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149280:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474ec9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149309:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474ebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fa7 expref: 18 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149321:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a4474ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fa7 expref: 17 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.149327:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388119.149329:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787388119.149331:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7600, rc 0) 00000100:00100000:3.0:1787388119.149445:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+17:12230:x1874211925730560:12345-192.168.203.15@tcp:101:bash.0 Request processed in 646us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.149452:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 156 00000100:00100000:1.0:1787388119.153315:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.153445:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925730816 00000100:00100000:3.0:1787388119.153468:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925730816 00000100:00100000:3.0:1787388119.153523:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 157 00000100:00100000:3.0:1787388119.153534:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+17:12230:x1874211925730816:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1787388119.153556:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388119.153576:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474ed7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fae expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.153689:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474ede lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.153703:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474ede lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.153714:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474ede lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.153728:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.153734:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.153740:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787388119.154086:0:10197:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787388119.154214:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154224:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154245:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154278:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474ede lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154285:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474ede lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154292:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474ede lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154297:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388119.154300:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474ede lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154306:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474ede lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154316:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388119.154318:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388119.154323:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474ede lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154328:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474ede lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388119.154339:0:10197:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000022c4486 reply state 000000009c522b4d transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154379:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154392:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b51436200) 00010000:00010000:3.0:1787388119.154395:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388119.154397:0:10197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787388119.154428:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474ed7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fae expref: 20 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154442:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fae expref: 19 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.154449:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b51436700) 00010000:00010000:3.0:1787388119.154451:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388119.154453:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6c00, rc 0) 00000100:00100000:3.0:1787388119.154507:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+20:12230:x1874211925730816:12345-192.168.203.15@tcp:101:bash.0 Request processed in 975us (1202us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787388119.154514:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 157 00000100:00100000:2.0:1787388119.160456:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388119.160731:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925730944 00000100:00100000:1.0:1787388119.160740:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925730944 00000100:00100000:1.0:1787388119.160807:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:1.0:1787388119.160819:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a44048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925730944:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388119.160846:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388119.160868:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474efa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388119.160890:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388119.160924:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1787388119.160929:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388119.160938:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474efa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fb5 expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.160956:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474efa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fb5 expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.160970:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fa00, rc 0) 00000100:00100000:1.0:1787388119.161042:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a44048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925730944:12345-192.168.203.15@tcp:101:bash.0 Request processed in 227us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.161050:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00080000:3.0:1787388119.161499:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388119.167040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388119.167416:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925731072 00000100:00100000:1.0:1787388119.167435:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925731072 00000100:00100000:1.0:1787388119.167495:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:1.0:1787388119.167506:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:12230:x1874211925731072:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388119.167523:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388119.167542:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fbc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.167569:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474efa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fb5 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.167577:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388119.167581:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388119.167586:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.167645:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474efa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fb5 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.167658:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474efa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fb5 expref: 7 pid: 8434 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388119.167673:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874211945727744:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388119.167787:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388119.171550:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388119.171759:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925731200 00000100:00100000:2.0:1787388119.171767:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925731200 00010000:00010000:2.0:1787388119.171803:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474efa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fb5 expref: 8 pid: 8434 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388119.171849:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 81 00000100:00100000:2.0:1787388119.171858:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925731200:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388119.171872:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388119.171895:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474efa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fb5 expref: 8 pid: 8434 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.171907:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474efa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fb5 expref: 8 pid: 8434 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.171934:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388119.171938:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388119.171946:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.171955:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.171989:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388119.172123:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1874211945727872:192.168.203.15@tcp:105: 00000100:00100000:2.0:1787388119.172210:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4300 going to sleep for 11 seconds 00010000:00010000:1.0:1787388119.172394:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022f0d5e5/0x26817551a4474efa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fb5 expref: 8 pid: 8434 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388119.172408:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874211945727744:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388119.172441:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.172451:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fc00, rc 0) 00000100:00100000:1.0:1787388119.172480:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+7:12230:x1874211925731072:12345-192.168.203.15@tcp:101:bash.0 Request processed in 4976us (5451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.172487:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:1.0:1787388119.175319:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1874211945727872:192.168.203.15@tcp:105: 00010000:00010000:1.0:1787388119.175365:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388119.175417:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925731200:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 3560us (3875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.175451:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 81 00000100:00100000:0.0:1787388119.179565:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388119.179693:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925731456 00000100:00100000:1.0:1787388119.179703:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925731456 00000100:00100000:1.0:1787388119.179802:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:1.0:1787388119.179813:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+20:12230:x1874211925731456:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:1.0:1787388119.180115:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+21:12230:x1874211925731456:12345-192.168.203.15@tcp:35:bash.0 Request processed in 303us (558us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787388119.180124:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:0.0:1787388119.277848:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945728000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388119.277922:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388119.277988:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388119.277995:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4403e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945728128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388119.278019:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388119.278093:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945728000 00000100:00100000:3.0:1787388119.278101:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945728000 00000100:00100000:3.0:1787388119.278151:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945728128 00000100:00100000:3.0:1787388119.278153:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945728128 00000100:00100000:3.0:1787388119.278176:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787388119.278185:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945728000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388119.278212:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388119.278261:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945728000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.278268:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787388119.278284:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787388119.278303:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945728128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388119.278313:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787388119.278337:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945728128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.278343:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1787388119.278575:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388119.278614:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4403e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945728128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388119.278628:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945728000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388119.278855:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945728384:0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.278887:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388119.278913:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945728896:0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.278933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388119.278955:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945729408:0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.278977:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388119.279000:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787388119.279006:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945728256:0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.279033:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388119.279049:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945728768:0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.279068:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388119.279081:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945729280:0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.279100:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388119.279121:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945728384 00000100:00100000:3.0:1787388119.279127:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945728384 00000100:00100000:3.0:1787388119.279154:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945728896 00000100:00100000:3.0:1787388119.279158:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945728896 00000100:00100000:3.0:1787388119.279188:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945729408 00000100:00100000:3.0:1787388119.279191:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945729408 00000100:00100000:3.0:1787388119.279205:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787388119.279210:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945728384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.279258:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945728384:12345-0@lo:400:kworker.0 Request processed in 47us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.279265:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787388119.279276:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787388119.279282:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945728896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.279306:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945728896:12345-0@lo:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.279312:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787388119.279322:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787388119.279328:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945729408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.279377:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945729408:12345-0@lo:400:kworker.0 Request processed in 49us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.279382:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787388119.279407:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945728384:0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.279415:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945728896:0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.279423:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945729408:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.279702:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945728256 00000100:00100000:0.0:1787388119.279706:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945728256 00000100:00100000:0.0:1787388119.279739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787388119.279746:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945728256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.279785:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945728256:12345-0@lo:400:kworker.0 Request processed in 40us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.279802:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787388119.279964:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945728640:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.279993:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388119.280012:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945729152:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.280036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388119.280054:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787388119.280059:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945728512:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.280081:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388119.280095:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945729024:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.280114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388119.280126:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945729536:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.280146:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388119.280239:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945729280 00000100:00100000:1.0:1787388119.280244:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945729280 00000100:00100000:1.0:1787388119.280281:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945729152 00000100:00100000:1.0:1787388119.280284:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945729152 00000100:00100000:1.0:1787388119.280306:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787388119.280313:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945729280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388119.280376:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945729280:12345-0@lo:400:kworker.0 Request processed in 34us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.280382:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787388119.280395:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787388119.280401:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945729152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.280601:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945729152:0@lo:400:kworker.0 00000100:00080000:0.0:1787388119.280621:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787388119.280625:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388119.280636:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945728640 00000100:00100000:0.0:1787388119.280640:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945728640 00000100:00100000:0.0:1787388119.280656:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945729024 00000100:00100000:0.0:1787388119.280658:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945729024 00000100:00100000:0.0:1787388119.280676:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945729536 00000100:00100000:0.0:1787388119.280679:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945729536 00000100:00100000:0.0:1787388119.280692:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787388119.280698:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945728640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.280731:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945728640:12345-0@lo:400:kworker.0 Request processed in 33us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.280737:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787388119.280758:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787388119.280764:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945729024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.280792:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945729024:12345-0@lo:400:kworker.0 Request processed in 29us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.280797:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787388119.280807:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787388119.280813:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945729536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388119.280893:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945729152:12345-0@lo:400:kworker.0 Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.280899:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787388119.281009:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945728256:0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.281021:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945729280:0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.281133:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945728768 00000100:00100000:2.0:1787388119.281138:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945728768 00000100:00100000:2.0:1787388119.281227:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945728512 00000100:00100000:2.0:1787388119.281232:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945728512 00000100:00100000:2.0:1787388119.281248:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787388119.281255:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4403d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945728768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.281298:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4403d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945728768:12345-0@lo:400:kworker.0 Request processed in 44us (2228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.281305:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787388119.281319:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787388119.281325:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945728512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388119.281374:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945728512:12345-0@lo:400:kworker.0 Request processed in 49us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.281379:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787388119.281415:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945728768:0@lo:400:kworker.0 00000100:00080000:3.0:1787388119.281529:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388119.281552:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945728512:0@lo:400:kworker.0 00010000:00080000:3.0:1787388119.281565:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223f480 x1874211945729024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388119.281587:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945729024:0@lo:400:kworker.0 00000100:00100000:3.0:1787388119.281600:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945728640:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.281727:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945729536:12345-0@lo:400:kworker.0 Request processed in 913us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.281734:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00080000:3.0:1787388119.287582:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f5ead80 x1874211945729536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388119.287602:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945729536:0@lo:400:kworker.0 00000100:00100000:0.0:1787388119.295552:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388119.299036:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925731712 00000100:00100000:1.0:1787388119.299051:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925731712 00000100:00100000:1.0:1787388119.299126:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 158 00000100:00100000:1.0:1787388119.299136:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+21:12240:x1874211925731712:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388119.299383:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388119.299404:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474f08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fc3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388119.299580:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787388119.299682:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474f08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fc3 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.299696:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d0be00) 00010000:00010000:1.0:1787388119.299699:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388119.299705:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474f08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fc3 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.299717:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fa00, rc 0) 00000100:00100000:1.0:1787388119.299846:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+22:12240:x1874211925731712:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 712us (4303us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1787388119.299853:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 158 00000100:00100000:3.0:1787388119.304231:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388119.305726:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925731968 00000100:00100000:1.0:1787388119.305739:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925731968 00000100:00100000:1.0:1787388119.305796:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:1.0:1787388119.305807:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925731968:12345-192.168.203.15@tcp:16:kworker.0 00000100:00100000:1.0:1787388119.305944:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925731968:12345-192.168.203.15@tcp:16:kworker.0 Request processed in 139us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.305951:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:3.0:1787388119.306187:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.306299:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.306320:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.306340:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.307678:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.307702:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925732224 00000100:00100000:3.0:1787388119.307709:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925732224 00000100:00100000:3.0:1787388119.307761:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925732480 00000100:00100000:3.0:1787388119.307764:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925732480 00000100:00100000:3.0:1787388119.307787:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 346 00000100:00100000:3.0:1787388119.307796:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925732224:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388119.308051:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2400:x1874211925732224:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 255us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.308059:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 346 00000100:00100000:3.0:1787388119.308075:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 347 00000100:00100000:3.0:1787388119.308082:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925732480:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388119.308106:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2400:x1874211925732480:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.308125:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 347 00000100:00080000:3.0:1787388119.308142:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388119.308341:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925731840 00000100:00100000:1.0:1787388119.308359:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925731840 00002000:00100000:1.0:1787388119.308392:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff996a42d9b100 x1874211925731840/t0(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:375/0 lens 504/0 e 0 to 0 dl 1787388130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388119.308409:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a42d9b100 with x1874211925731840 ext(0->12) 00002000:00010000:1.0:1787388119.308415:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff996a42d9b100 00000100:00100000:1.0:1787388119.308448:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:1.0:1787388119.308455:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2401:x1874211925731840:12345-192.168.203.15@tcp:4:bash.0 00000100:00100000:0.0:1787388119.309759:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925732352 00000100:00100000:0.0:1787388119.309768:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925732352 00000100:00100000:0.0:1787388119.310168:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:0.0:1787388119.310181:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2400:x1874211925732352:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388119.310250:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2400:x1874211925732352:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 72us (3928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.310257:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:0.0:1787388119.310281:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925732096 00000100:00100000:0.0:1787388119.310285:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925732096 00000100:00100000:0.0:1787388119.310311:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 395 00000100:00100000:0.0:1787388119.310317:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925732096:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388119.310363:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925732096:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (4045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.310739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 395 00000100:00080000:0.0:1787388119.310784:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388119.311569:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925731840:12345-192.168.203.15@tcp:4:bash.0 Request processed in 3109us (5377us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787388119.311579:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00002000:00100000:1.0:1787388119.311590:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff996a42d9b100 x1874211925731840/t4294967306(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:375/0 lens 504/448 e 0 to 0 dl 1787388130 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388119.311600:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a42d9b100 with x1874211925731840 ext(0->12) 00002000:00010000:1.0:1787388119.311619:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff996a42d9b100 00000100:00100000:3.0:1787388119.312996:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388119.313083:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925732736 00000100:00100000:2.0:1787388119.313091:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925732736 00000100:00100000:2.0:1787388119.313816:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:2.0:1787388119.313961:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+22:12240:x1874211925732736:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388119.314222:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+23:12240:x1874211925732736:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 266us (1399us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787388119.314231:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:1.0:1787388119.394208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.394398:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925732864 00000100:00100000:3.0:1787388119.394410:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925732864 00000100:00100000:3.0:1787388119.394478:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 159 00000100:00100000:3.0:1787388119.394489:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+23:12246:x1874211925732864:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388119.394511:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388119.394531:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fca expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.394596:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474f1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.394609:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.394619:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388119.394663:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787388119.394666:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388119.394684:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.394723:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fca expref: 25 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.394740:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fca expref: 24 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.394763:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388119.394766:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388119.394769:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6200, rc 0) 00000100:00100000:3.0:1787388119.394844:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+24:12246:x1874211925732864:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 356us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.394853:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 159 00000100:00100000:0.0:1787388119.399395:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.400402:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925733120 00000100:00100000:3.0:1787388119.400413:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925733120 00000100:00100000:3.0:1787388119.400473:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 160 00000100:00100000:3.0:1787388119.400482:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+24:12246:x1874211925733120:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388119.400499:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388119.400517:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fd1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.400786:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474f2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.400800:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474f2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.400809:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474f2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388119.400893:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787388119.401586:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fd1 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.401809:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474f2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fd1 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.401992:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b51436700) 00010000:00010000:3.0:1787388119.402052:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388119.402057:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7400, rc 0) 00000100:00100000:3.0:1787388119.402919:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+26:12246:x1874211925733120:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 2431us (3566us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1787388119.402927:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 160 00000100:00100000:1.0:1787388119.411080:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.415185:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388119.415275:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925733504 00000100:00100000:1.0:1787388119.415284:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925733504 00000100:00100000:1.0:1787388119.415340:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 161 00000100:00100000:1.0:1787388119.415378:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+26:12246:x1874211925733504:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388119.415402:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388119.415422:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fd8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.415518:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474f40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.415532:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474f40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.415555:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474f40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388119.415568:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787388119.415664:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fd8 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.415679:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474f40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fd8 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.415686:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b51436700) 00010000:00010000:1.0:1787388119.415689:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787388119.415692:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fa00, rc 0) 00000100:00100000:1.0:1787388119.415744:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+28:12246:x1874211925733504:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 368us (567us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1787388119.415750:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 161 00000100:00100000:0.0:1787388119.418334:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925733248 00000100:00100000:0.0:1787388119.418359:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925733248 00000100:00100000:0.0:1787388119.418483:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:0.0:1787388119.418493:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+28:2400:x1874211925733248:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388119.418508:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388119.418533:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4474f2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fd1 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.418552:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b51436700) 00010000:00010000:0.0:1787388119.418556:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388119.418626:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+27:2400:x1874211925733248:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 135us (7555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.418641:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:3.0:1787388119.423135:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388119.423237:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925733632 00000100:00100000:1.0:1787388119.423247:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925733632 00000100:00100000:1.0:1787388119.423401:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:1.0:1787388119.423413:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925733632:12345-192.168.203.15@tcp:1:lfs.0 00010000:00010000:1.0:1787388119.423458:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.423487:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.423497:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388119.423514:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388119.423519:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.423554:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.423568:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 8 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388119.423583:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1874211945729664:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388119.423672:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388119.427512:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1874211945729664:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388119.427548:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388119.433289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388119.433403:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925733760 00000100:00100000:1.0:1787388119.433413:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925733760 00010000:00010000:1.0:1787388119.433459:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 9 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388119.433518:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 82 00000100:00100000:1.0:1787388119.433529:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+9:2402:x1874211925733760:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388119.433543:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787388119.433560:0:7462:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787388119.433563:0:7462:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787388119 00002000:00010000:1.0:1787388119.433578:0:7462:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787388119 00002000:00010000:1.0:1787388119.433580:0:7462:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787388119.433588:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 9 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.433603:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 9 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.433628:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029235c95/0x26817551a4474f01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fbc expref: 9 pid: 8436 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.433655:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388119.433660:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388119.433666:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.433676:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.433722:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388119.433781:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388119.433785:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925733760:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 257us (505us total) trans 0 rc 0/0 00010000:00010000:2.0:1787388119.433801:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388119.433802:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 82 00010000:00010000:2.0:1787388119.433842:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.433852:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.433859:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.433866:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388119.433870:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.433879:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.433891:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.433898:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59d45d8/0x26817551a4474f4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388119.433959:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:2401:x1874211925733632:12345-192.168.203.15@tcp:1:lfs.0 Request processed in 10549us (10832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.433968:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:3.0:1787388119.439895:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388119.440452:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925734016 00000100:00100000:1.0:1787388119.440472:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925734016 00000100:00100000:1.0:1787388119.440527:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:1.0:1787388119.440537:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dcc9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+27:12246:x1874211925734016:12345-192.168.203.15@tcp:35:lfs.0 00000004:00010000:1.0:1787388119.440624:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474f40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fd8 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388119.440949:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1787388119.440986:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787388119.441480:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1787388119.441518:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.441534:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fae expref: 31 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.441544:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.441578:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fae expref: 31 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.441592:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fae expref: 31 pid: 10197 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388119.442012:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874211945729792:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388119.442117:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5845fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388119.447633:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388119.447792:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925734144 00000100:00100000:2.0:1787388119.447801:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925734144 00010000:00010000:2.0:1787388119.447857:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fae expref: 32 pid: 10197 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388119.447890:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 83 00000100:00100000:1.0:1787388119.447901:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874211945729792:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388119.447902:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+32:2401:x1874211925734144:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388119.447920:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388119.447928:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fae expref: 32 pid: 10197 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.447933:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.447945:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fae expref: 32 pid: 10197 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.457880:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6c00/0x26817551a4474eec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fae expref: 32 pid: 10197 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.457907:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b51436700) 00010000:00010000:2.0:1787388119.457913:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.457922:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.457949:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.458028:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388119.458385:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.458402:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388119.458590:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787388119.458881:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+32:2401:x1874211925734144:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 10979us (11255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.458892:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 83 00000001:00080000:1.0:1787388119.459603:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1787388119.460143:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945729920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787388119.460210:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388119.460245:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388119.461806:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945729920 00000100:00100000:2.0:1787388119.461815:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945729920 00000100:00100000:2.0:1787388119.461881:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787388119.461892:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874211945729920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787388119.462013:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874211945729920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388119.462020:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787388119.462113:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945729920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787388119.462253:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1787388119.462336:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945730048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787388119.462396:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388119.462418:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a4235a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388119.462658:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945730048 00000100:00100000:3.0:1787388119.462663:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945730048 00000100:00100000:3.0:1787388119.462697:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787388119.462705:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b62293450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1874211945730048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787388119.462813:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b62293450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1874211945730048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (417us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787388119.462820:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787388119.463775:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945730048:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787388119.463843:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1787388119.463943:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.463955:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.463982:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.463989:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388119.463993:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.464014:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.464029:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b51436700) 00010000:00010000:3.0:1787388119.464033:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787388119.464037:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.464043:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a4474f55 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787388119.464151:0:6523:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787388119.464229:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787388119.464243:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440986894553ns, next at 441986892479ns, rc = 0 00000001:00080000:3.0:1787388119.464249:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1787388119.464277:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b51436700) 00010000:00010000:3.0:1787388119.464280:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787388119.464287:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4474f40 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fd8 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388119.464466:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dcc9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+34:12246:x1874211925734016:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 23929us (24578us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787388119.464486:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000020:00080000:3.0:1787388119.464491:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787388119.476636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388119.476849:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925734272 00000100:00100000:0.0:1787388119.476860:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925734272 00000100:00100000:0.0:1787388119.476924:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:0.0:1787388119.476935:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+34:12246:x1874211925734272:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388119.476959:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388119.476982:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474f5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fdf expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.477065:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474f5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fdf expref: 35 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.477080:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474f5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fdf expref: 35 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388119.477098:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:0.0:1787388119.477102:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787388119.477105:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030000, rc 0) 00000100:00100000:0.0:1787388119.477165:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+35:12246:x1874211925734272:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 232us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388119.477173:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:0.0:1787388119.481909:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388119.482009:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925734528 00000100:00100000:2.0:1787388119.482019:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925734528 00000100:00100000:2.0:1787388119.482072:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:2.0:1787388119.482082:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+35:12246:x1874211925734528:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388119.482338:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+36:12246:x1874211925734528:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 256us (436us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787388119.482389:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:3.0:1787388119.563916:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388119.564035:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925734784 00000100:00100000:0.0:1787388119.564044:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925734784 00000100:00100000:0.0:1787388119.564112:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 163 00000100:00100000:0.0:1787388119.564124:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+36:12256:x1874211925734784:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388119.564147:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388119.564168:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474f63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fe6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388119.564270:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787388119.566389:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474f63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fe6 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.566431:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d0be00) 00010000:00010000:2.0:1787388119.566434:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388119.566440:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474f63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fe6 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.566456:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030400, rc 0) 00000100:00100000:2.0:1787388119.566532:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+37:12256:x1874211925734784:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 2410us (2624us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1787388119.566542:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 163 00000100:00100000:0.0:1787388119.569912:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388119.569993:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925734912 00000100:00100000:3.0:1787388119.570012:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925734912 00000100:00100000:3.0:1787388119.570070:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 164 00000100:00100000:3.0:1787388119.570080:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+37:12256:x1874211925734912:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:3.0:1787388119.570157:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f71 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.570184:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.570198:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.570209:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.570216:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.570222:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.571270:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.571553:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.571577:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388119.571705:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.571719:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.571726:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f71 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.571733:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.571739:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388119.572220:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572230:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f71 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572243:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388119.572246:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388119.572250:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572256:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4474f71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572270:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572283:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572289:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572294:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388119.572297:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572303:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572312:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b51436200) 00010000:00010000:3.0:1787388119.572314:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388119.572317:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f78 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572322:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474f78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572332:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572338:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.572343:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.573108:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388119.573120:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.573126:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.573136:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:3.0:1787388119.573139:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388119.573142:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388119.573148:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474f7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388119.573801:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+37:12256:x1874211925734912:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 3716us (3892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388119.573811:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 164 00000100:00100000:0.0:1787388119.577947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388119.578039:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925735168 00000100:00100000:2.0:1787388119.578048:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925735168 00000100:00100000:2.0:1787388119.578103:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:2.0:1787388119.578114:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+37:12256:x1874211925735168:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388119.578343:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+38:12256:x1874211925735168:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 230us (404us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787388119.578376:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 40 00010000:00010000:3.0:1787388119.660516:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388119.673248:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388119.673342:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925735424 00000100:00100000:2.0:1787388119.673383:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925735424 00000100:00100000:2.0:1787388119.673442:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 165 00000100:00100000:2.0:1787388119.673451:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+38:12259:x1874211925735424:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388119.673474:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388119.673506:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474f86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7fed expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673580:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474f8d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673607:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474f8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673618:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474f8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673629:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474f94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673636:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673642:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673749:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673758:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673764:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388119.673772:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787388119.673856:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474f8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673864:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474f8d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673871:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474f8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673883:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388119.673888:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474f8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673896:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474f8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673908:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:2.0:1787388119.673912:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388119.673916:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474f8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673922:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474f8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673936:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673943:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474f94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673949:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474f94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673954:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388119.673956:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474f94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673962:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474f94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673982:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b51436200) 00010000:00010000:2.0:1787388119.673984:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388119.673987:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474f94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.673993:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474f94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.674028:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474f86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fed expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.674042:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fed expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388119.674048:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:2.0:1787388119.674050:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388119.674053:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5ce00, rc 0) 00000100:00100000:2.0:1787388119.674121:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+40:12259:x1874211925735424:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 670us (881us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787388119.674129:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 165 00000100:00100000:0.0:1787388119.681851:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388119.681950:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925735552 00000100:00100000:1.0:1787388119.681960:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925735552 00000100:00100000:1.0:1787388119.682027:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 166 00000100:00100000:1.0:1787388119.682039:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+40:12259:x1874211925735552:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:1.0:1787388119.682114:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474fa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.682131:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.682143:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.682176:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.682183:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474fa9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.682189:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.682208:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388119.682213:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.682220:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.682231:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388119.682235:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388119.682239:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474fa9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388119.682245:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4474fa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388119.682316:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+40:12259:x1874211925735552:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 279us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388119.682324:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 166 00000100:00100000:0.0:1787388119.693105:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388119.695173:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925735808 00000100:00100000:2.0:1787388119.695254:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925735808 00000100:00100000:2.0:1787388119.695407:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:2.0:1787388119.695418:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+40:12259:x1874211925735808:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388119.695665:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+41:12259:x1874211925735808:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 247us (2568us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787388119.695672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:3.0:1787388120.085979:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388120.086189:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925736064 00000100:00100000:0.0:1787388120.086199:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925736064 00000100:00100000:0.0:1787388120.086255:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 167 00000100:00100000:0.0:1787388120.086264:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+41:12290:x1874211925736064:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:0.0:1787388120.086287:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388120.086307:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ff4 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.086430:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474fb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.086443:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.086453:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388120.086463:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787388120.086554:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ff4 expref: 44 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.086571:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ff4 expref: 43 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.086580:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:0.0:1787388120.086583:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388120.086586:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030400, rc 0) 00000100:00100000:0.0:1787388120.086728:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+43:12290:x1874211925736064:12345-192.168.203.15@tcp:101:cat.0 Request processed in 464us (756us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787388120.086749:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 167 00000100:00100000:0.0:1787388120.091034:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388120.091087:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388120.091248:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925736448 00000100:00100000:3.0:1787388120.091259:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925736448 00000100:00100000:3.0:1787388120.091310:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:3.0:1787388120.091319:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+43:12290:x1874211925736448:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:1.0:1787388120.091443:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925736192 00000100:00100000:1.0:1787388120.091447:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925736192 00000100:00100000:1.0:1787388120.091482:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:1.0:1787388120.091488:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+45:2402:x1874211925736192:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388120.091499:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388120.091522:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4474fb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ff4 expref: 45 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.091540:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388120.091544:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388120.091572:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+44:12290:x1874211925736448:12345-192.168.203.15@tcp:35:cat.0 Request processed in 253us (483us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1787388120.091572:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+44:2402:x1874211925736192:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 84us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388120.091579:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:1.0:1787388120.091580:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:3.0:1787388120.163992:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388120.164094:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925736704 00000100:00100000:2.0:1787388120.164102:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925736704 00000100:00100000:2.0:1787388120.164165:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 168 00000100:00100000:2.0:1787388120.164174:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+43:12296:x1874211925736704:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:2.0:1787388120.164196:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388120.164199:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787388120.164224:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4474f1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fca expref: 43 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.164243:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:2.0:1787388120.164247:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388120.164261:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474fc5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe7ffb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.164409:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.164424:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fed expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.164432:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.164462:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fed expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.164476:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fed expref: 43 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388120.164509:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945730176:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388120.164757:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787388120.171166:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945730176:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388120.171200:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388120.173068:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388120.173157:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925736832 00000100:00100000:1.0:1787388120.173166:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925736832 00010000:00010000:1.0:1787388120.173206:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fed expref: 44 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388120.173248:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 84 00000100:00100000:1.0:1787388120.173258:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+44:2401:x1874211925736832:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388120.173272:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388120.173278:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fed expref: 44 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.173292:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fed expref: 44 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.173317:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a4474f9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fed expref: 44 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.173332:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388120.173337:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.173382:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.173398:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.173443:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388120.173493:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+43:2401:x1874211925736832:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 235us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388120.173502:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 84 00010000:00010000:3.0:1787388120.173519:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388120.173540:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388120.173557:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787388120.173761:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a4474fc5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ffb expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.173777:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ffb expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.173784:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388120.173787:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388120.173790:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d800, rc 0) 00000100:00100000:1.0:1787388120.173837:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+43:12296:x1874211925736704:12345-192.168.203.15@tcp:101:dd.0 Request processed in 9664us (9854us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787388120.173844:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 168 00000100:00100000:0.0:1787388120.177706:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388120.177785:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925736960 00000100:00100000:3.0:1787388120.177793:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925736960 00000100:00100000:3.0:1787388120.177859:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 169 00000100:00100000:3.0:1787388120.177869:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+43:12296:x1874211925736960:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:3.0:1787388120.177893:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388120.177912:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474fda lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8002 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388120.177948:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388120.177962:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388120.177972:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388120.178469:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a4474fda lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8002 expref: 45 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388120.178486:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8002 expref: 44 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388120.178494:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:3.0:1787388120.178503:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787388120.178507:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7a00, rc 0) 00000100:00100000:3.0:1787388120.178602:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+44:12296:x1874211925736960:12345-192.168.203.15@tcp:101:dd.0 Request processed in 733us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388120.178610:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 169 00000100:00100000:3.0:1787388120.182626:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388120.182723:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925737216 00000100:00100000:0.0:1787388120.182732:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925737216 00000100:00100000:0.0:1787388120.182783:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 170 00000100:00100000:0.0:1787388120.182793:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+44:12296:x1874211925737216:12345-192.168.203.15@tcp:36:dd.0 00010000:00010000:0.0:1787388120.183024:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.183041:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.183052:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388120.183098:0:13515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1787388120.183119:0:13515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000881598b5 reply state 0000000072c577cb transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.183131:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.183139:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:0.0:1787388120.183142:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388120.183145:0:13515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787388120.183475:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+47:12296:x1874211925737216:12345-192.168.203.15@tcp:36:dd.0 Request processed in 682us (856us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1787388120.183496:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 170 00000020:00080000:0.0:1787388120.183502:0:13515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787388120.302298:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388120.302326:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945730304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388120.302439:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388120.302738:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945730304 00000100:00100000:2.0:1787388120.302746:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945730304 00000100:00100000:2.0:1787388120.302799:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787388120.302816:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945730304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388120.302858:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388120.302909:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945730304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388120.302917:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787388120.303647:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945730304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388120.544447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388120.545023:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925737344 00000100:00100000:2.0:1787388120.545033:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925737344 00000100:00100000:2.0:1787388120.545110:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 171 00000100:00100000:2.0:1787388120.545121:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+47:12310:x1874211925737344:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:2.0:1787388120.545143:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388120.545166:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474fef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8009 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545233:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474ff6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545247:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545276:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545287:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474ffd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545294:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474ffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545301:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474ffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545409:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545421:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ffb expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545429:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545463:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ffb expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.545476:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ffb expref: 48 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388120.545491:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945730432:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388120.545786:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787388120.549167:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945730432:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388120.549264:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388120.549866:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388120.552801:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925737600 00000100:00100000:0.0:1787388120.552815:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925737600 00000100:00100000:0.0:1787388120.552901:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:0.0:1787388120.552911:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+49:6170:x1874211925737600:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787388120.553425:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+50:6170:x1874211925737600:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 513us (3559us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787388120.553434:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:3.0:1787388120.559883:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388120.560373:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925737728 00000100:00100000:1.0:1787388120.560383:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925737728 00010000:00010000:1.0:1787388120.560424:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ffb expref: 50 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388120.560470:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 85 00000100:00100000:1.0:1787388120.560481:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+50:2401:x1874211925737728:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388120.560497:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388120.560503:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ffb expref: 50 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.560534:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ffb expref: 50 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.560555:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4474fcc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7ffb expref: 50 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.560570:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388120.560575:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.560583:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.560590:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.560679:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388120.560741:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+49:2401:x1874211925737728:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 262us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388120.560750:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 85 00010000:00010000:2.0:1787388120.565101:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565119:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388120.565288:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787388120.565293:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388120.565317:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565333:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565342:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565373:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474ff6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565380:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565385:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388120.565389:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565396:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565430:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:2.0:1787388120.565434:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388120.565438:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474ff6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565444:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c000/0x26817551a4474ff6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565459:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474ffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565464:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474ffd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565469:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474ffd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565473:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5de00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388120.565475:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474ffd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565480:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474ffd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565487:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b51436200) 00010000:00010000:2.0:1787388120.565489:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388120.565492:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474ffd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565496:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4474ffd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565545:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4474fef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8009 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565558:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8009 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.565564:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:2.0:1787388120.565566:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388120.565568:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5dc00, rc 0) 00000100:00100000:2.0:1787388120.567560:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+48:12310:x1874211925737344:12345-192.168.203.15@tcp:101:stat.0 Request processed in 22431us (23112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388120.567572:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 171 00000100:00100000:3.0:1787388120.648003:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388120.648222:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925737984 00000100:00100000:0.0:1787388120.648229:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925737984 00000100:00100000:0.0:1787388120.648310:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 172 00000100:00100000:0.0:1787388120.648318:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+48:12316:x1874211925737984:12345-192.168.203.15@tcp:36:truncate.0 00010000:00010000:0.0:1787388120.648392:0:10197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388120.648417:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475004 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8009 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.648430:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:0.0:1787388120.648433:0:10197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388120.648580:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.648619:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.648628:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787388120.648928:0:10197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787388120.648951:0:10197:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c32ae6b reply state 0000000047c20068 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.648963:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.648970:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:0.0:1787388120.648972:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787388120.648975:0:10197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787388120.649075:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+50:12316:x1874211925737984:12345-192.168.203.15@tcp:36:truncate.0 Request processed in 755us (1079us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787388120.649083:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 172 00000020:00080000:0.0:1787388120.649088:0:10197:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787388120.686832:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388120.794020:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388120.794083:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925738112 00000100:00100000:1.0:1787388120.794092:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925738112 00000100:00100000:1.0:1787388120.794163:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 173 00000100:00100000:1.0:1787388120.794175:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+50:12330:x1874211925738112:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:1.0:1787388120.794198:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388120.794228:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4475012 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8010 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.794320:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475019 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.794334:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.794376:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.794387:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475020 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.794394:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.794400:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.794753:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.794762:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.794769:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388120.794832:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787388120.794946:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388120.794968:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.794994:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795004:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795010:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475019 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795016:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475019 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795021:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388120.795025:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475019 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795033:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475019 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795045:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:1.0:1787388120.795048:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388120.795052:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475019 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795058:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475019 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795071:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795077:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475020 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795090:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475020 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795094:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4ec00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388120.795097:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475020 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795102:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475020 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795111:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b51436200) 00010000:00010000:1.0:1787388120.795113:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388120.795116:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475020 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795121:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475020 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795153:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a4475012 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8010 expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795166:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8010 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.795174:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388120.795176:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388120.795179:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f600, rc 0) 00000100:00100000:1.0:1787388120.795259:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+51:12330:x1874211925738112:12345-192.168.203.15@tcp:101:stat.0 Request processed in 1086us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388120.795275:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 173 00000100:00100000:1.0:1787388120.903421:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388120.903507:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925738368 00000100:00100000:2.0:1787388120.903516:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925738368 00000100:00100000:2.0:1787388120.903568:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 174 00000100:00100000:2.0:1787388120.903577:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+51:12340:x1874211925738368:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388120.903600:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388120.903619:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a447502e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8017 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388120.903707:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787388120.903794:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a447502e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8017 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.903808:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d0be00) 00010000:00010000:2.0:1787388120.903811:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388120.903837:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a447502e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8017 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.903850:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d600, rc 0) 00000100:00100000:2.0:1787388120.903962:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+52:12340:x1874211925738368:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 384us (547us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1787388120.903970:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 174 00000100:00100000:0.0:1787388120.911776:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388120.911879:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925738624 00000100:00100000:3.0:1787388120.911889:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925738624 00000100:00100000:3.0:1787388120.911979:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:3.0:1787388120.911991:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dccb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+52:12340:x1874211925738624:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1787388120.912549:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dccb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+53:12340:x1874211925738624:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 558us (778us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1787388120.912558:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:0.0:1787388120.980801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388120.980925:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925738880 00000100:00100000:3.0:1787388120.980935:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925738880 00000100:00100000:3.0:1787388120.981063:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 175 00000100:00100000:3.0:1787388120.981073:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+53:12346:x1874211925738880:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1787388120.981093:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388120.981111:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a447503c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe801e expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388120.981212:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388120.981311:0:10197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8010 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388120.981320:0:10197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.981638:0:10197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8010 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388120.981654:0:10197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8010 expref: 54 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388120.981670:0:10197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945730560:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388120.981800:0:10197:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388120.985091:0:10197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945730560:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388120.985122:0:10197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388120.985929:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388120.986384:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925739008 00000100:00100000:1.0:1787388120.986403:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925739008 00010000:00010000:1.0:1787388120.986444:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8010 expref: 55 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388120.986483:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 86 00000100:00100000:1.0:1787388120.986492:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+55:2402:x1874211925739008:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388120.986508:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388120.986515:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8010 expref: 55 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.986527:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8010 expref: 55 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.986550:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475027 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8010 expref: 55 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.986565:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388120.986571:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.986580:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.986586:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.986640:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388120.986699:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+54:2402:x1874211925739008:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 208us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388120.986708:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 86 00010000:00010000:0.0:1787388120.986889:0:10197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.986898:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388120.986928:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787388120.987072:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a447503c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe801e expref: 55 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.987087:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe801e expref: 54 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388120.987094:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:0.0:1787388120.987097:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787388120.987100:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7800, rc 0) 00000100:00100000:0.0:1787388120.987126:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+54:12346:x1874211925738880:12345-192.168.203.15@tcp:101:bash.0 Request processed in 6055us (6333us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787388120.987133:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 175 00000100:00100000:0.0:1787388120.994604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388120.994680:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925739264 00000100:00100000:1.0:1787388120.994689:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925739264 00000100:00100000:1.0:1787388120.994797:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 176 00000100:00100000:1.0:1787388120.994807:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+54:12346:x1874211925739264:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:1.0:1787388120.995039:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.995056:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.995067:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388120.995110:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1787388120.995129:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020311409 reply state 00000000527d0445 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.995140:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388120.995147:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388120.995150:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388120.995154:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388120.995249:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+57:12346:x1874211925739264:12345-192.168.203.15@tcp:36:bash.0 Request processed in 443us (653us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1787388120.995271:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 176 00000020:00080000:1.0:1787388120.995276:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787388121.004791:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.004968:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925739392 00000100:00100000:0.0:1787388121.004978:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925739392 00000100:00100000:0.0:1787388121.005086:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 177 00000100:00100000:0.0:1787388121.005096:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+57:12346:x1874211925739392:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1787388121.005117:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388121.005136:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475058 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8025 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.005225:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.005239:0:13515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe801e expref: 58 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.005247:0:13515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.005294:0:13515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe801e expref: 58 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.005307:0:13515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe801e expref: 58 pid: 10197 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388121.005321:0:13515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43836d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945730688:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388121.005446:0:13515:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a4235af00 going to sleep for 11 seconds 00000100:00080000:3.0:1787388121.007900:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388121.008589:0:13515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43836d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945730688:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388121.008630:0:13515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388121.009901:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388121.010165:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925739520 00000100:00100000:1.0:1787388121.010173:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925739520 00010000:00010000:1.0:1787388121.010209:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe801e expref: 59 pid: 10197 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388121.010247:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 87 00000100:00100000:1.0:1787388121.010258:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+59:2401:x1874211925739520:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388121.010270:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388121.010277:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe801e expref: 59 pid: 10197 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.010290:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe801e expref: 59 pid: 10197 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.010312:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475043 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe801e expref: 59 pid: 10197 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.010328:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388121.010333:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.010342:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.010393:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.010447:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388121.010497:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+58:2401:x1874211925739520:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 240us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388121.010505:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 87 00010000:00010000:3.0:1787388121.010758:0:13515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.010766:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388121.010831:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787388121.010836:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388121.010856:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.010885:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475058 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8025 expref: 58 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.010900:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8025 expref: 57 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.010919:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:3.0:1787388121.010921:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388121.010924:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030c00, rc 0) 00000100:00100000:3.0:1787388121.010965:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+57:12346:x1874211925739392:12345-192.168.203.15@tcp:101:bash.0 Request processed in 5870us (6183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388121.010971:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 177 00000100:00100000:3.0:1787388121.014909:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388121.015087:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925739776 00000100:00100000:2.0:1787388121.015096:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925739776 00000100:00100000:2.0:1787388121.015230:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:2.0:1787388121.015241:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+57:12346:x1874211925739776:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:2.0:1787388121.015659:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+58:12346:x1874211925739776:12345-192.168.203.15@tcp:35:bash.0 Request processed in 418us (757us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787388121.015668:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:1.0:1787388121.114635:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.114905:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925740032 00000100:00100000:0.0:1787388121.114914:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925740032 00000100:00100000:0.0:1787388121.114973:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 178 00000100:00100000:0.0:1787388121.114981:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+58:12356:x1874211925740032:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388121.115011:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388121.115030:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe802c expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388121.115269:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787388121.115393:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475066 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe802c expref: 60 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.115407:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d0be00) 00010000:00010000:0.0:1787388121.115410:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388121.115414:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe802c expref: 60 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.115428:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030400, rc 0) 00000100:00100000:0.0:1787388121.115792:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+59:12356:x1874211925740032:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 810us (1164us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1787388121.115800:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 178 00000100:00100000:3.0:1787388121.122676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.122749:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925740160 00000100:00100000:0.0:1787388121.122760:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925740160 00000100:00100000:0.0:1787388121.122831:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 179 00000100:00100000:0.0:1787388121.122842:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+59:12356:x1874211925740160:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:0.0:1787388121.122913:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a4475074 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.122928:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a4475074 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.122939:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a4475074 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.122949:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447507b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.122955:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447507b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.122961:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447507b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123051:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123061:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123067:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388121.123140:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123155:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a4475074 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123175:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a4475074 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123182:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a4475074 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123188:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08c00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388121.123192:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a4475074 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123198:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a4475074 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123209:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:0.0:1787388121.123381:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388121.123388:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a4475074 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123395:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a4475074 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123410:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447507b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123416:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447507b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123429:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447507b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123434:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388121.123436:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447507b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123442:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447507b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123450:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b51436200) 00010000:00010000:0.0:1787388121.123453:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388121.123456:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447507b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123462:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a447507b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123472:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123479:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123484:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123490:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388121.123492:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123508:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123516:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:0.0:1787388121.123518:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388121.123521:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.123526:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475082 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388121.124503:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+59:12356:x1874211925740160:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 1657us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388121.124513:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 179 00000100:00100000:3.0:1787388121.128080:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.128218:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925740416 00000100:00100000:0.0:1787388121.128226:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925740416 00000100:00100000:0.0:1787388121.128278:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:0.0:1787388121.128286:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+59:12356:x1874211925740416:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1787388121.128498:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+60:12356:x1874211925740416:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 212us (426us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787388121.128505:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:1.0:1787388121.200605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388121.200694:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925740672 00000100:00100000:3.0:1787388121.200703:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925740672 00000100:00100000:3.0:1787388121.200763:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 180 00000100:00100000:3.0:1787388121.200772:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+60:12359:x1874211925740672:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388121.200794:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388121.200917:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475089 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8033 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.200985:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475090 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201007:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475090 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201018:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475090 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201029:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201047:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201054:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201148:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447509e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201157:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447509e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201325:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447509e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388121.201335:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787388121.201748:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475090 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201758:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475090 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201764:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475090 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201769:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388121.201773:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475090 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201780:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475090 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201861:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388121.201865:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388121.201870:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475090 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201876:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475090 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201889:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201895:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475097 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201900:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201905:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388121.201908:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201914:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475097 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201923:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b51436200) 00010000:00010000:3.0:1787388121.201925:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388121.201927:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475097 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201933:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475097 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.201980:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475089 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8033 expref: 63 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.202003:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447509e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8033 expref: 62 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388121.202011:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:3.0:1787388121.202013:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388121.202015:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7200, rc 0) 00000100:00100000:3.0:1787388121.202113:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+62:12359:x1874211925740672:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1341us (1517us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787388121.202120:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 180 00000100:00100000:2.0:1787388121.209222:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388121.209290:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.209452:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925740800 00000100:00100000:0.0:1787388121.209462:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925740800 00000100:00100000:0.0:1787388121.209520:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 181 00000100:00100000:0.0:1787388121.209530:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+62:12359:x1874211925740800:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:0.0:1787388121.209590:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.209615:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.209625:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.209659:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.209665:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.209672:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.209677:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388121.209681:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.209688:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.209697:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:0.0:1787388121.209700:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388121.209703:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.209709:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388121.209792:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+62:12359:x1874211925740800:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 263us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388121.209804:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 181 00000100:00100000:1.0:1787388121.212800:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925740928 00000100:00100000:1.0:1787388121.212824:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925740928 00000100:00100000:1.0:1787388121.212953:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:1.0:1787388121.212964:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+62:2399:x1874211925740928:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388121.212980:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388121.213015:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447509e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8033 expref: 62 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.213034:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388121.213039:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388121.213102:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+61:2399:x1874211925740928:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 140us (3811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388121.213109:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:2.0:1787388121.228085:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.228178:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925741184 00000100:00100000:0.0:1787388121.228189:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925741184 00000100:00100000:0.0:1787388121.228247:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:0.0:1787388121.228256:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+61:12359:x1874211925741184:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1787388121.228523:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+62:12359:x1874211925741184:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 267us (447us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787388121.228531:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:2.0:1787388121.324852:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945730816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388121.324924:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388121.326901:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945730944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388121.326964:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388121.327141:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945730816 00000100:00100000:3.0:1787388121.327149:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945730816 00000100:00100000:3.0:1787388121.327201:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945730944 00000100:00100000:3.0:1787388121.327204:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945730944 00000100:00100000:3.0:1787388121.327218:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787388121.327225:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945730816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388121.327252:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787388121.327289:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945730816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388121.327296:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787388121.327309:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787388121.327314:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945730944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388121.327322:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787388121.327341:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945730944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 27us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388121.327381:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1787388121.327442:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388121.327476:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945730944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388121.327617:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945730816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388121.528509:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388121.531475:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925741440 00000100:00100000:1.0:1787388121.531490:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925741440 00000100:00100000:1.0:1787388121.531569:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 182 00000100:00100000:1.0:1787388121.531580:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+62:12377:x1874211925741440:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:1.0:1787388121.533950:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388121.533981:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe803a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.534128:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44750ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.534143:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44750ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.534157:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44750ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388121.534386:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787388121.534581:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe803a expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.534898:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44750ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe803a expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.534907:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388121.534910:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787388121.534913:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ec00, rc 0) 00000100:00100000:1.0:1787388121.535073:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+64:12377:x1874211925741440:12345-192.168.203.15@tcp:101:cat.0 Request processed in 3493us (6571us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1787388121.535082:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 182 00000100:00100000:3.0:1787388121.579694:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.579854:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925741568 00000100:00100000:0.0:1787388121.579863:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925741568 00000100:00100000:0.0:1787388121.579945:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 183 00000100:00100000:0.0:1787388121.579956:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+64:12378:x1874211925741568:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388121.579980:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388121.580013:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8041 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.580077:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44750cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.580091:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44750cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.580102:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44750cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388121.580163:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787388121.580167:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388121.580185:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44750cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.580224:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a44750c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8041 expref: 66 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.580241:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44750cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8041 expref: 65 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.580248:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:0.0:1787388121.580251:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388121.580253:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08200, rc 0) 00000100:00100000:0.0:1787388121.580307:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+65:12378:x1874211925741568:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 353us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388121.580314:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 183 00000100:00100000:2.0:1787388121.586179:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.586259:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925741952 00000100:00100000:0.0:1787388121.586268:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925741952 00000100:00100000:0.0:1787388121.586324:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:0.0:1787388121.586333:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+65:12378:x1874211925741952:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1787388121.586744:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+66:12378:x1874211925741952:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 409us (572us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787388121.586752:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:3.0:1787388121.593119:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388121.593310:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925742080 00000100:00100000:1.0:1787388121.593319:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925742080 00000100:00100000:1.0:1787388121.593413:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:1.0:1787388121.593424:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+66:12378:x1874211925742080:12345-192.168.203.15@tcp:103:lfs.0 00010000:00010000:1.0:1787388121.593439:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787388121.593478:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a447505f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8025 expref: 66 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.593501:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44750ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe803a expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.593514:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4474f5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fdf expref: 64 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.593523:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388121.593528:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388121.593725:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+63:12378:x1874211925742080:12345-192.168.203.15@tcp:103:lfs.0 Request processed in 167us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388121.593734:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:3.0:1787388121.598404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388121.598538:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925742208 00000100:00100000:2.0:1787388121.598548:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925742208 00000100:00100000:2.0:1787388121.598602:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 184 00000100:00100000:2.0:1787388121.598614:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+63:12378:x1874211925742208:12345-192.168.203.15@tcp:58:lfs.0 00010000:00010000:2.0:1787388121.598725:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a44750d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388121.598742:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a44750d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388121.598753:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a44750d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388121.598860:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787388121.598955:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+63:12378:x1874211925742208:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 343us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388121.598963:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 184 00000100:00100000:2.0:1787388121.642788:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388121.643049:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925742336 00000100:00100000:1.0:1787388121.643061:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925742336 00000100:00100000:1.0:1787388121.643179:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 185 00000100:00100000:1.0:1787388121.643190:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+63:12380:x1874211925742336:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388121.643209:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388121.643229:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44750dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8048 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643297:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643312:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643323:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643388:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643397:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643405:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643471:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643481:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643488:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388121.643530:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787388121.643534:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388121.643551:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643563:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643571:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643578:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750e4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643596:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643602:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388121.643606:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643614:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750e4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643626:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:1.0:1787388121.643629:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388121.643633:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643639:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a44750e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643652:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643658:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643663:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643668:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388121.643671:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643687:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643696:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b51436200) 00010000:00010000:1.0:1787388121.643698:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388121.643701:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643705:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643732:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a44750dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8048 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643745:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8048 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.643752:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388121.643754:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388121.643756:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ea00, rc 0) 00000100:00100000:1.0:1787388121.643824:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+64:12380:x1874211925742336:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 637us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388121.643833:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 185 00010000:00010000:3.0:1787388121.708507:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388121.900550:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787388121.900561:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787388121.900595:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787388121.900602:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787388121.900746:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945731072:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787388121.907366:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a4235a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787388121.916117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388121.916172:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925742464 00000100:00100000:2.0:1787388121.916181:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925742464 00000100:00100000:2.0:1787388121.916244:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 186 00000100:00100000:2.0:1787388121.916254:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+65:12391:x1874211925742464:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787388121.916286:0:13515:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787388121.916422:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+65:12391:x1874211925742464:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 168us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388121.916430:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 186 00000100:00100000:3.0:1787388121.916705:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945731072:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787388121.924252:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388121.924554:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925742592 00000100:00100000:1.0:1787388121.924563:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925742592 00000100:00100000:1.0:1787388121.924632:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 187 00000100:00100000:1.0:1787388121.924642:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+64:12391:x1874211925742592:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787388121.924724:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924741:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924750:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924827:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475100 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924836:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475100 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924843:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475100 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924871:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924882:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924889:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388121.924933:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787388121.924938:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388121.924949:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924961:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924974:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924980:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924986:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388121.924990:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.924997:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925010:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:1.0:1787388121.925013:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388121.925017:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925023:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44750f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925034:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475100 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925039:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475100 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925044:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475100 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925049:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388121.925057:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475100 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925064:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475100 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925072:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff996b728f7600) 00010000:00010000:1.0:1787388121.925075:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388121.925077:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475100 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925082:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475100 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925097:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925103:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925108:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925113:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388121.925115:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925121:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925128:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388121.925130:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388121.925139:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.925160:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475107 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388121.925938:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+64:12391:x1874211925742592:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 1291us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388121.925948:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 187 00000100:00100000:3.0:1787388121.928767:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388121.929372:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925742848 00000100:00100000:1.0:1787388121.929383:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925742848 00000100:00100000:1.0:1787388121.929441:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 188 00000100:00100000:1.0:1787388121.929452:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+64:12391:x1874211925742848:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388121.929472:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388121.929493:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a447510e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe804f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.929743:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475115 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.929759:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.929770:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388121.929782:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787388121.929874:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.929883:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475115 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.929904:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475115 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.929910:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388121.929915:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475115 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.929922:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475115 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.929934:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388121.929937:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388121.929941:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475115 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.929947:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475115 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.929989:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a447510e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe804f expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.930000:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:1.0:1787388121.930002:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388121.930006:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a447510e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe804f expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.930016:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f200, rc 0) 00000100:00100000:1.0:1787388121.930083:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+65:12391:x1874211925742848:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 633us (1324us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1787388121.930101:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 188 00000100:00100000:3.0:1787388121.934441:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.934838:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925742976 00000100:00100000:0.0:1787388121.934851:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925742976 00000100:00100000:0.0:1787388121.934914:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 189 00000100:00100000:0.0:1787388121.934923:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b49a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+65:12391:x1874211925742976:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787388121.934957:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787388121.935069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b49a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+65:12391:x1874211925742976:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 147us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388121.935077:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 189 00000100:00100000:3.0:1787388121.941134:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.941220:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925743232 00000100:00100000:0.0:1787388121.941231:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925743232 00000100:00100000:0.0:1787388121.941294:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 190 00000100:00100000:0.0:1787388121.941303:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+65:12391:x1874211925743232:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388121.941323:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388121.941326:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787388121.941365:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08200/0x26817551a44750cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8041 expref: 65 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.941386:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:0.0:1787388121.941391:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388121.941403:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a4475123 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8056 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787388121.941756:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787388121.941926:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a447512a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.941938:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a447512a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.941947:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a447512a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.941999:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09400/0x26817551a4475123 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8056 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.942012:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a447512a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8056 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.942020:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0b700) 00010000:00010000:0.0:1787388121.942023:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388121.942025:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08c00, rc 0) 00000100:00100000:0.0:1787388121.942093:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+66:12391:x1874211925743232:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 790us (966us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787388121.942100:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 190 00000100:00100000:3.0:1787388121.950645:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.951887:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925743488 00000100:00100000:0.0:1787388121.951901:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925743488 00000100:00100000:0.0:1787388121.951963:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 191 00000100:00100000:0.0:1787388121.951973:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+66:12391:x1874211925743488:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787388121.952051:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388121.952076:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08c00/0x26817551a447512a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8056 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952105:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0b700) 00010000:00010000:0.0:1787388121.952116:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388121.952137:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475138 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952148:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475138 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952157:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475138 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952202:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447513f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x11c0f97 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952209:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447513f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x11c0f97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952216:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447513f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x11c0f97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952258:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475138 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952265:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475138 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952272:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475138 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952278:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388121.952282:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475138 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952295:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475138 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952304:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:0.0:1787388121.952306:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388121.952310:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475138 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952316:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08000/0x26817551a4475138 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952326:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447513f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x11c0f97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952332:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447513f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11c0f97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952338:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447513f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11c0f97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952342:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388121.952362:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447513f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11c0f97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952368:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447513f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11c0f97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952374:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x11c0f97 (ffff996b74d0b900) 00010000:00010000:0.0:1787388121.952376:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388121.952379:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447513f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x11c0f97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.952394:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447513f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x11c0f97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388121.952475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+65:12391:x1874211925743488:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 502us (1838us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787388121.952482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 191 00000100:00100000:3.0:1787388121.958554:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388121.958625:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925743616 00000100:00100000:0.0:1787388121.958634:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925743616 00000100:00100000:0.0:1787388121.958690:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 192 00000100:00100000:0.0:1787388121.958701:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4311ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+65:12391:x1874211925743616:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388121.958721:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388121.958744:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475146 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe805d expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.958778:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.958791:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.958802:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.958921:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475146 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe805d expref: 67 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.958940:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe805d expref: 66 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388121.958959:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:0.0:1787388121.958963:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388121.958966:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030400, rc 0) 00000100:00100000:0.0:1787388121.959029:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4311ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+66:12391:x1874211925743616:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 329us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388121.959037:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 192 00000100:00100000:3.0:1787388121.973378:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388121.973421:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925743872 00000100:00100000:1.0:1787388121.973431:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925743872 00000100:00100000:1.0:1787388121.973494:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 193 00000100:00100000:1.0:1787388121.973503:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+66:12391:x1874211925743872:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787388121.973586:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.973602:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.973613:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388121.973780:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787388121.973789:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443496441831ns, next at 444496440184ns, rc = 0 00000004:00010000:1.0:1787388121.973848:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dca66542 reply state 00000000f2e8fb58 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.973861:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388121.973868:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:1.0:1787388121.973871:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787388121.973875:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388121.973965:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+68:12391:x1874211925743872:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 462us (617us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787388121.973972:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 193 00000100:00100000:0.0:1787388121.985798:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388121.985887:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925744000 00000100:00100000:2.0:1787388121.985896:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925744000 00000100:00100000:2.0:1787388121.985954:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 194 00000100:00100000:2.0:1787388121.985963:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+68:12391:x1874211925744000:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388121.985984:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388121.986003:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a447515b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8064 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388121.986058:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a447515b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8064 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388121.986071:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a447515b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8064 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388121.986089:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:2.0:1787388121.986093:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787388121.986096:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5cc00, rc 0) 00000100:00100000:2.0:1787388121.986549:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+69:12391:x1874211925744000:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 584us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388121.986573:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 194 00000100:00100000:0.0:1787388121.997109:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388121.997335:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925744128 00000100:00100000:1.0:1787388121.997379:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925744128 00000100:00100000:1.0:1787388121.997448:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:1.0:1787388121.997460:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+6:2402:x1874211925744128:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787388121.997708:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925744128:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 249us (606us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787388121.997717:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00080000:3.0:1787388121.997785:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388122.000908:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388122.000998:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925744384 00000100:00100000:3.0:1787388122.001008:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925744384 00000100:00100000:3.0:1787388122.001071:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:3.0:1787388122.001083:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+69:12391:x1874211925744384:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787388122.001300:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+70:12391:x1874211925744384:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 218us (399us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787388122.001308:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:2.0:1787388122.003468:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388122.004115:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925744640 00000100:00100000:3.0:1787388122.004124:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925744640 00000100:00100000:3.0:1787388122.004174:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 195 00000100:00100000:3.0:1787388122.004184:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+70:12391:x1874211925744640:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787388122.004316:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+70:12391:x1874211925744640:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 132us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388122.004324:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 195 00000100:00100000:0.0:1787388122.011019:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388122.011073:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925744768 00000100:00100000:3.0:1787388122.011083:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925744768 00000100:00100000:3.0:1787388122.011143:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 196 00000100:00100000:3.0:1787388122.011153:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+70:12391:x1874211925744768:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388122.011173:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388122.011193:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475162 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe806b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.011262:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.011276:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.011287:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388122.011332:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388122.011374:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.011412:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475162 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe806b expref: 72 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.011428:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe806b expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.012548:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:3.0:1787388122.012551:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787388122.012556:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6800, rc 0) 00000100:00100000:3.0:1787388122.012626:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+71:12391:x1874211925744768:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1473us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388122.012635:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 196 00000100:00100000:2.0:1787388122.035273:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.036030:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925744896 00000100:00100000:1.0:1787388122.036041:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925744896 00000100:00100000:1.0:1787388122.036107:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:1.0:1787388122.036118:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+7:2401:x1874211925744896:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388122.036137:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388122.036158:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4475170 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8072 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388122.036184:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8960da, blocks: 0x0 00010000:00010000:1.0:1787388122.036206:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1787388122.036211:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388122.036220:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4475170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8072 expref: 8 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.036235:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4475170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8072 expref: 8 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.036247:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fc00, rc 0) 00000100:00100000:1.0:1787388122.036311:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925744896:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 196us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388122.036336:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:0.0:1787388122.048141:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388122.048340:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925745152 00000100:00100000:2.0:1787388122.048385:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925745152 00000100:00100000:2.0:1787388122.048502:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 197 00000100:00100000:2.0:1787388122.048513:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+71:12391:x1874211925745152:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787388122.048614:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+71:12391:x1874211925745152:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 102us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388122.048623:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 197 00000100:00100000:0.0:1787388122.054517:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388122.054613:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925745280 00000100:00100000:3.0:1787388122.054622:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925745280 00000100:00100000:3.0:1787388122.054676:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:3.0:1787388122.054685:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:12391:x1874211925745280:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388122.054702:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388122.054719:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8079 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.054747:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4475170 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8072 expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.054755:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388122.054760:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388122.054765:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.054796:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4475170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8072 expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.054838:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4475170 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8072 expref: 9 pid: 8490 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388122.054854:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f593b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874211945731200:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388122.054941:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787388122.061794:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388122.061837:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925745408 00000100:00100000:0.0:1787388122.061846:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925745408 00010000:00010000:0.0:1787388122.061883:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4475170 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8072 expref: 10 pid: 8490 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388122.061920:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 88 00000100:00100000:0.0:1787388122.061930:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+10:2402:x1874211925745408:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388122.061944:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388122.061967:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4475170 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8072 expref: 10 pid: 8490 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.061993:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4475170 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8072 expref: 10 pid: 8490 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.062040:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388122.062045:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388122.062053:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.062064:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.062102:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388122.062118:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1874211945731328:192.168.203.15@tcp:105: 00000100:00100000:0.0:1787388122.062212:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a4235a540 going to sleep for 11 seconds 00010000:00010000:2.0:1787388122.062624:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029235c95/0x26817551a4475170 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8072 expref: 10 pid: 8490 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388122.062639:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f593b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874211945731200:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388122.062661:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.062671:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6e00, rc 0) 00000100:00100000:2.0:1787388122.062711:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+9:12391:x1874211925745280:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 8028us (8202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388122.062719:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:0.0:1787388122.076164:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388122.076728:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1874211945731328:192.168.203.15@tcp:105: 00010000:00010000:2.0:1787388122.076754:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388122.076818:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925745408:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 14879us (15021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388122.076837:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 88 00000100:00100000:1.0:1787388122.081314:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925745536 00000100:00100000:1.0:1787388122.081328:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925745536 00002000:00100000:1.0:1787388122.081404:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff996b7f58fb80 x1874211925745536/t0(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:378/0 lens 504/0 e 0 to 0 dl 1787388133 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388122.081416:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b7f58fb80 with x1874211925745536 ext(0->8) 00002000:00010000:1.0:1787388122.081421:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b7f58fb80 00000100:00100000:1.0:1787388122.081458:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:1.0:1787388122.081467:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925745536:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787388122.083288:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+10:2402:x1874211925745536:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 Request processed in 1814us (7124us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787388122.083302:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00002000:00100000:1.0:1787388122.083314:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff996b7f58fb80 x1874211925745536/t4294967315(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:378/0 lens 504/448 e 0 to 0 dl 1787388133 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388122.083325:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b7f58fb80 with x1874211925745536 ext(0->8) 00002000:00010000:1.0:1787388122.083331:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b7f58fb80 00000100:00100000:0.0:1787388122.088181:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388122.088688:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925745664 00000100:00100000:3.0:1787388122.088699:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925745664 00000100:00100000:3.0:1787388122.088761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 198 00000100:00100000:3.0:1787388122.088770:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+71:12391:x1874211925745664:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787388122.095670:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1787388122.095688:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1787388122.095748:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:2.0:1787388122.095839:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095851:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095859:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095865:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7e00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.095869:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095877:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095892:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff996b51436900) 00010000:00010000:2.0:1787388122.095895:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388122.095899:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095906:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a4474e9f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095926:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095932:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095951:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095956:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.095959:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095965:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095973:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:2.0:1787388122.095976:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388122.095989:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.095996:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4474ea6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096011:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096018:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096023:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096028:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.096031:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096047:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096055:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b51436200) 00010000:00010000:2.0:1787388122.096057:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388122.096060:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096066:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4474ee5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096080:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096087:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096092:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096096:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.096099:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096105:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096113:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:2.0:1787388122.096115:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388122.096118:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096129:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4474fe8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096141:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096147:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096152:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096157:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.096160:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096166:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096174:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:2.0:1787388122.096176:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388122.096178:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096184:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447500b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096193:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096199:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096210:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096215:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.096218:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096224:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096234:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:2.0:1787388122.096236:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388122.096238:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096244:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475051 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096254:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096260:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096266:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096270:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.096273:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096288:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096296:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:2.0:1787388122.096298:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787388122.096301:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.096307:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475154 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388122.096530:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945731456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787388122.096593:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388122.100318:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388122.101294:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945731456 00000100:00100000:1.0:1787388122.101303:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945731456 00000100:00100000:1.0:1787388122.101379:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787388122.101389:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945731456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787388122.101501:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787388122.101504:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787388122 00002000:00010000:1.0:1787388122.101507:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787388122.101509:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787388122 -> 1787388122 00002000:00010000:1.0:1787388122.101524:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:3.0:1787388122.101638:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996a4235ae40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787388122.101643:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b73a4f600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996a4235ad80 00000020:00080000:3.0:1787388122.101646:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b73a4f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996b739ad200 00000100:00100000:3.0:1787388122.101779:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+19:12391:x1874211925745664:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 13008us (13605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388122.101789:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 198 00000020:00080000:0.0:1787388122.104466:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787388122.104546:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787388122.107634:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945731584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787388122.107712:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388122.107821:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945731584 00000100:00100000:3.0:1787388122.107829:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945731584 00000100:00100000:3.0:1787388122.107884:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787388122.107895:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945731584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787388122.107921:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1787388122.107964:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8960d7, atime: 0x0, ctime: 0x6a8960d7, blocks: 0x8 00010000:00010000:3.0:1787388122.107972:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a447517e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.107997:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1787388122.108002:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388122.108007:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a447517e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.108023:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a447517e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.108032:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a447517e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.108039:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a447517e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.108061:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787388122.108206:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1874211945731584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 314us (493us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787388122.108214:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787388122.108235:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388122.108417:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945731456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7028us (11822us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787388122.108425:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:1.0:1787388122.108441:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388122.108446:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a447517e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.108455:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7000 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388122.108460:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a447517e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.108470:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a447517e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.108485:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a447517e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.108493:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a447517e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.108509:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388122.108511:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388122.108513:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388122.108639:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.108697:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925745792 00000100:00100000:1.0:1787388122.108701:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925745792 00000100:00100000:1.0:1787388122.108724:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:1.0:1787388122.108730:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+10:2400:x1874211925745792:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1787388122.109317:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996b7f58df80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1787388122.109327:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945731456:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1787388122.110002:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996b52ef0700/2, rc 0, transno 4294967308 00000100:00100000:2.0:1787388122.110009:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945731584:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787388122.110107:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1787388122.110115:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1787388122.110469:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:2400:x1874211925745792:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 1735us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388122.110478:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:1.0:1787388122.118599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388122.118688:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925746048 00000100:00100000:3.0:1787388122.118698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925746048 00000100:00100000:3.0:1787388122.118766:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 199 00000100:00100000:3.0:1787388122.118776:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+19:12391:x1874211925746048:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787388122.118855:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388122.118884:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475169 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe806b expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.118901:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:3.0:1787388122.118905:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388122.118935:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.118948:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.118957:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388122.119083:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be2d7fa1 reply state 000000002a76e3f4 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.119095:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.119102:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:3.0:1787388122.119105:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388122.119107:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388122.119223:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+20:12391:x1874211925746048:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 447us (640us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787388122.119230:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 199 00000100:00100000:3.0:1787388122.125295:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.125391:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925746176 00000100:00100000:1.0:1787388122.125401:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925746176 00000100:00100000:1.0:1787388122.125452:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:1.0:1787388122.125462:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925746176:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787388122.125612:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787388122.125615:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787388122 -> 1787388121 00002000:00010000:1.0:1787388122.125618:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787388119 00002000:00010000:1.0:1787388122.125621:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787388122 -> 1787388121 00002000:00010000:1.0:1787388122.125623:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787388122.125698:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925746176:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 237us (413us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787388122.125705:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:3.0:1787388122.130588:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.130680:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925746432 00000100:00100000:1.0:1787388122.130690:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925746432 00000100:00100000:1.0:1787388122.130746:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 200 00000100:00100000:1.0:1787388122.130756:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+20:12391:x1874211925746432:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787388122.130837:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.130854:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe805d expref: 20 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.130863:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.130911:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe805d expref: 20 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.130924:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe805d expref: 20 pid: 10197 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.130939:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945731712:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388122.131145:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42260000 going to sleep for 11 seconds 00000100:00100000:0.0:1787388122.136077:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.137524:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945731712:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388122.137552:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.137584:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925746560 00000100:00100000:1.0:1787388122.137591:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925746560 00010000:00010000:1.0:1787388122.137622:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe805d expref: 21 pid: 10197 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.137707:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 89 00000100:00100000:1.0:1787388122.137716:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+21:2400:x1874211925746560:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388122.137730:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388122.137737:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe805d expref: 21 pid: 10197 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.137748:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe805d expref: 21 pid: 10197 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.137787:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a447514d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe805d expref: 21 pid: 10197 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.137803:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:1.0:1787388122.137807:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.137825:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.137831:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.138156:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388122.138226:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+20:2400:x1874211925746560:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 509us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388122.138235:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 89 00010000:00010000:2.0:1787388122.138403:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.138411:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.138449:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.138456:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.138474:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.138479:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fa00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.138483:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.138490:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.138498:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:2.0:1787388122.138500:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787388122.138504:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.138510:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a447518c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388122.138548:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+19:12391:x1874211925746432:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 Request processed in 7793us (7969us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787388122.138555:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 200 00000100:00100000:1.0:1787388122.141438:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388122.141513:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925746688 00000100:00100000:2.0:1787388122.141522:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925746688 00000100:00100000:2.0:1787388122.141572:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:2.0:1787388122.141580:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925746688:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787388122.141621:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.141639:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.141657:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388122.141662:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388122.141666:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.141698:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.141711:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 8 pid: 8436 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388122.141726:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874211945731840:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388122.141800:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388122.147309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388122.148971:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874211945731840:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388122.149003:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388122.149561:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925746816 00000100:00100000:0.0:1787388122.149570:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925746816 00010000:00010000:0.0:1787388122.149602:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 9 pid: 8436 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388122.149636:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 90 00000100:00100000:0.0:1787388122.149645:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+9:2401:x1874211925746816:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388122.149658:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388122.149681:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 9 pid: 8436 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.149694:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 9 pid: 8436 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.149717:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a4475177 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8079 expref: 9 pid: 8436 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.149730:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388122.149735:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388122.149741:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.149750:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.149773:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388122.149837:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925746816:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 192us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388122.149851:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 90 00010000:00010000:2.0:1787388122.150014:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.150035:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.150055:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.150070:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.150078:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.150086:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5ca00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388122.150090:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.150100:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.150112:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.150120:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df5240fe/0x26817551a4475193 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388122.150183:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925746688:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 8603us (8752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388122.150192:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:0.0:1787388122.153664:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388122.153744:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925747072 00000100:00100000:3.0:1787388122.153754:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925747072 00000100:00100000:3.0:1787388122.153844:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 201 00000100:00100000:3.0:1787388122.153854:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+19:12391:x1874211925747072:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787388122.153932:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.153949:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8002 expref: 19 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.153958:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.154109:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8002 expref: 19 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.154124:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8002 expref: 19 pid: 10197 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388122.154139:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945731968:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388122.154367:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787388122.160978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.161050:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925747200 00000100:00100000:1.0:1787388122.161060:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925747200 00010000:00010000:1.0:1787388122.161099:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8002 expref: 20 pid: 10197 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.161142:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 91 00000100:00100000:1.0:1787388122.161151:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+20:2401:x1874211925747200:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388122.161166:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388122.161173:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8002 expref: 20 pid: 10197 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.161202:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8002 expref: 20 pid: 10197 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.161226:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388122.161231:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.161240:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.161246:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.161266:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388122.161319:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+20:2401:x1874211925747200:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 168us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388122.161327:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 91 00010000:00010000:3.0:1787388122.161733:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4474fe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8002 expref: 19 pid: 10197 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388122.161751:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945731968:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388122.161771:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.161845:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.161854:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.162017:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.162088:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a447515b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8064 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.162096:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.162126:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a447515b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8064 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.162139:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a447515b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8064 expref: 19 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388122.162153:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945732096:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388122.162259:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4480 going to sleep for 11 seconds 00000100:00100000:3.0:1787388122.166428:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945732096:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388122.166456:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388122.168687:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.168805:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925747328 00000100:00100000:1.0:1787388122.168824:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925747328 00010000:00010000:1.0:1787388122.168866:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a447515b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8064 expref: 20 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.168907:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 92 00000100:00100000:1.0:1787388122.168917:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+20:2401:x1874211925747328:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388122.168931:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388122.168938:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a447515b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8064 expref: 20 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.168970:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a447515b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8064 expref: 20 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.168995:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a447515b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8064 expref: 20 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.169010:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:1.0:1787388122.169015:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.169035:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.169043:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.169068:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388122.169087:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.169100:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.169123:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+19:2401:x1874211925747328:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 208us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388122.169130:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 92 00000001:00080000:3.0:1787388122.169219:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1787388122.169337:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1787388122.169410:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1787388122.169487:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1874211945732224:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787388122.169537:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388122.169568:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787388122.169603:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945732224 00000100:00100000:0.0:1787388122.169609:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945732224 00000100:00100000:0.0:1787388122.169648:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787388122.169656:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1874211945732224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787388122.169740:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1874211945732224:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388122.169747:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787388122.169946:0:6520:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787388122.169951:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996b7f58df80, transno 4294967316 00000100:00100000:3.0:1787388122.169970:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1874211945732224:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787388122.170083:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1787388122.170132:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1874211945732352:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787388122.170162:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388122.170183:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388122.170206:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945732352 00000100:00100000:1.0:1787388122.170210:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945732352 00000100:00100000:1.0:1787388122.170232:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787388122.170238:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1874211945732352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787388122.170330:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6520:x1874211945732352:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (167us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787388122.170337:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787388122.170561:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1874211945732352:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787388122.170605:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170613:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170620:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170625:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388122.170629:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170643:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170657:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:3.0:1787388122.170660:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388122.170665:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170670:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a44751a1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170693:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a44750d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170698:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a44750d6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170703:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a44750d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170707:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388122.170710:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a44750d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170715:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a44750d6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170721:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:3.0:1787388122.170723:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388122.170726:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a44750d6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170741:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a44750d6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170944:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170957:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8048 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170964:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.170999:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8048 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.171012:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8048 expref: 22 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388122.171023:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945732480:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388122.171090:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388122.177902:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388122.178013:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945732480:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388122.178042:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.178467:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925747456 00000100:00100000:1.0:1787388122.178474:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925747456 00010000:00010000:1.0:1787388122.178510:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8048 expref: 23 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.178547:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 93 00000100:00100000:1.0:1787388122.178557:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+23:2402:x1874211925747456:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388122.178571:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388122.178577:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8048 expref: 23 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.178589:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8048 expref: 23 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.178611:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44750f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8048 expref: 23 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.178625:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:1.0:1787388122.178630:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.178640:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.178647:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.178675:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388122.178708:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178715:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.178728:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+22:2402:x1874211925747456:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 171us (834us total) trans 0 rc 0/0 00010000:00010000:3.0:1787388122.178738:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.178742:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 93 00010000:00010000:3.0:1787388122.178745:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178750:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178757:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388122.178761:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178768:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178777:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:3.0:1787388122.178780:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388122.178784:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178789:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751a8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178799:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178806:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178823:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178835:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388122.178838:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178843:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178851:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0b200) 00010000:00010000:3.0:1787388122.178854:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787388122.178857:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.178862:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447519a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388122.179015:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+21:12391:x1874211925747072:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 25163us (25360us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787388122.179024:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 201 00000020:00080000:3.0:1787388122.179027:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787388122.179161:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388122.179166:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388122.179994:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787388122.180006:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787388122.185249:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.185325:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925747712 00000100:00100000:1.0:1787388122.185335:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925747712 00000100:00100000:1.0:1787388122.185577:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:1.0:1787388122.185717:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dccb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+21:12391:x1874211925747712:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787388122.186285:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787388122.186321:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1787388122.186528:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.186545:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.186556:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.186565:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.186571:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.186578:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.186757:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787388122.186876:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dccb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+23:12391:x1874211925747712:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 1289us (1775us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787388122.186885:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 50 00000020:00080000:1.0:1787388122.186891:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787388122.190105:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388122.190240:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.190252:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4ea00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388122.190257:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.190266:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.190306:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:3.0:1787388122.190309:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787388122.190314:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.190320:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a44751af lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.190335:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388122.190337:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388122.190339:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388122.547380:0:14609:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388122.547388:0:14609:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388122.547414:0:14609:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787388122.547427:0:14609:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787388122.732609:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388122.758014:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388122.758084:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925747968 00000100:00100000:3.0:1787388122.758094:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925747968 00000100:00100000:3.0:1787388122.758147:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 202 00000100:00100000:3.0:1787388122.758157:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+23:12401:x1874211925747968:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388122.758180:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388122.758197:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44751b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8080 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.758303:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.758317:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.758327:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388122.758364:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787388122.758460:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44751b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8080 expref: 26 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.758474:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8080 expref: 25 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388122.758483:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388122.758486:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787388122.758489:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7a00, rc 0) 00000100:00100000:3.0:1787388122.758539:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+25:12401:x1874211925747968:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 383us (534us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787388122.758545:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 202 00000100:00100000:3.0:1787388122.767567:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388122.768395:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925748096 00000100:00100000:2.0:1787388122.768405:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925748096 00000100:00100000:2.0:1787388122.768453:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 203 00000100:00100000:2.0:1787388122.768463:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+25:12401:x1874211925748096:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:2.0:1787388122.768530:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44751cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768547:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44751cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768558:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44751cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768573:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44751d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768579:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44751d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768587:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44751d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768671:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768680:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768688:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388122.768732:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768753:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44751cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768760:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44751cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768768:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44751cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768774:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.768777:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44751cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.768785:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44751cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769060:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:2.0:1787388122.769064:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388122.769068:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44751cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769076:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44751cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769088:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44751d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769094:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44751d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769100:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44751d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769113:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5dc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.769116:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44751d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769123:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44751d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769134:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b4900c100) 00010000:00010000:2.0:1787388122.769136:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388122.769140:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44751d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769145:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a44751d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769162:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769167:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769173:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769179:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388122.769182:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769188:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769205:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b4900cf00) 00010000:00010000:2.0:1787388122.769207:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388122.769210:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.769216:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44751d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388122.769307:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+25:12401:x1874211925748096:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 844us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388122.769316:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 203 00000100:00100000:3.0:1787388122.837471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388122.837613:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925748352 00000100:00100000:0.0:1787388122.837624:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925748352 00000100:00100000:0.0:1787388122.837685:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 204 00000100:00100000:0.0:1787388122.837695:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+25:12404:x1874211925748352:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388122.837716:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388122.837738:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44751e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8087 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.837821:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44751e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.837835:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44751e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.837846:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44751e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.837877:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44751ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.837897:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44751ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.837903:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44751ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838020:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838029:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838035:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388122.838045:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787388122.838123:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44751e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838131:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44751e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838138:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44751e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838144:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388122.838149:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44751e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838168:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44751e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838180:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:0.0:1787388122.838183:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388122.838188:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44751e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838195:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a44751e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838220:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44751ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838226:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44751ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838233:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44751ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838237:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388122.838240:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44751ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838246:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44751ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838254:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b74d0b000) 00010000:00010000:0.0:1787388122.838256:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388122.838258:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44751ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838274:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44751ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838317:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44751e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8087 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838331:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8087 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.838406:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:0.0:1787388122.838409:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388122.838411:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030000, rc 0) 00000100:00100000:0.0:1787388122.838469:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+27:12404:x1874211925748352:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 775us (1007us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787388122.838478:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 204 00000100:00100000:2.0:1787388122.846404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.846502:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925748480 00000100:00100000:1.0:1787388122.846512:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925748480 00000100:00100000:1.0:1787388122.846573:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 205 00000100:00100000:1.0:1787388122.846584:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+27:12404:x1874211925748480:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:1.0:1787388122.846664:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4475203 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.846682:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4475203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.846695:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4475203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.846731:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4475203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.846739:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4475203 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.846746:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4475203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.846751:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388122.846756:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4475203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.846781:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4475203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.846810:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:1.0:1787388122.846814:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388122.846818:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4475203 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.846825:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f800/0x26817551a4475203 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.846900:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+27:12404:x1874211925748480:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 317us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388122.846908:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 205 00000100:00100000:3.0:1787388122.850701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388122.850912:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925748736 00000100:00100000:0.0:1787388122.850923:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925748736 00000100:00100000:0.0:1787388122.850984:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:0.0:1787388122.850995:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+27:12404:x1874211925748736:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1787388122.851224:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+28:12404:x1874211925748736:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 231us (545us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1787388122.851232:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:3.0:1787388122.897968:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388122.899398:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925748992 00000100:00100000:2.0:1787388122.899411:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925748992 00000100:00100000:2.0:1787388122.899481:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 206 00000100:00100000:2.0:1787388122.899491:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+28:11937:x1874211925748992:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388122.899514:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388122.899536:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447520a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe808e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.899665:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.899680:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8087 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.899687:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.899738:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8087 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.899750:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8087 expref: 29 pid: 6520 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388122.899764:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211945732608:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388122.900400:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787388122.905709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.906008:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925749120 00000100:00100000:1.0:1787388122.906018:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925749120 00010000:00010000:1.0:1787388122.906059:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8087 expref: 30 pid: 6520 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388122.906099:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 94 00000100:00100000:1.0:1787388122.906109:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+30:2402:x1874211925749120:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388122.906124:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388122.906130:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8087 expref: 30 pid: 6520 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.906143:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8087 expref: 30 pid: 6520 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.906575:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:1.0:1787388122.906592:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.906600:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.906607:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388122.906628:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388122.906686:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+30:2402:x1874211925749120:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 578us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388122.906695:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 94 00010000:00010000:0.0:1787388122.908439:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44751f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8087 expref: 29 pid: 6520 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388122.908462:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211945732608:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388122.908502:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.908512:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.908517:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388122.908536:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787388122.908762:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a447520a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe808e expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.908778:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe808e expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.908786:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:0.0:1787388122.908866:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787388122.908870:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d600, rc 0) 00000100:00100000:0.0:1787388122.909045:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+29:11937:x1874211925748992:12345-192.168.203.15@tcp:101:bash.0 Request processed in 9554us (11084us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1787388122.909054:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 206 00000100:00100000:2.0:1787388122.917649:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388122.917747:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925749248 00000100:00100000:0.0:1787388122.917756:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925749248 00000100:00100000:0.0:1787388122.917832:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 207 00000100:00100000:0.0:1787388122.917844:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a422a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+29:11937:x1874211925749248:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1787388122.917866:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388122.917885:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447521f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8095 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.917936:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475226 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.917950:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.917961:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.918078:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a447521f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8095 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.918095:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475226 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8095 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.918103:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:0.0:1787388122.918106:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388122.918109:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030400, rc 0) 00000100:00100000:0.0:1787388122.918176:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a422a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+30:11937:x1874211925749248:12345-192.168.203.15@tcp:101:bash.0 Request processed in 336us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388122.918183:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 207 00000100:00100000:3.0:1787388122.921896:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388122.922059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925749504 00000100:00100000:2.0:1787388122.922069:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925749504 00000100:00100000:2.0:1787388122.922129:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 208 00000100:00100000:2.0:1787388122.922139:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+30:11937:x1874211925749504:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:2.0:1787388122.922384:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.922398:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.922408:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787388122.922451:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1787388122.922472:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020632a95 reply state 00000000bede46a0 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.922484:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.922505:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:2.0:1787388122.922508:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388122.922511:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787388122.922552:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1787388122.922647:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+34:11937:x1874211925749504:12345-192.168.203.15@tcp:36:bash.0 Request processed in 508us (759us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787388122.922655:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 208 00000020:00080000:2.0:1787388122.922660:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787388122.931536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388122.931762:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925749632 00000100:00100000:0.0:1787388122.931771:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925749632 00000100:00100000:0.0:1787388122.931945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 209 00000100:00100000:0.0:1787388122.931956:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+34:11937:x1874211925749632:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1787388122.931987:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388122.932007:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475234 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe809c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.932082:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475234 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe809c expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.932095:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475234 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe809c expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388122.932114:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:0.0:1787388122.932117:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787388122.932120:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030000, rc 0) 00000100:00100000:0.0:1787388122.932189:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+35:11937:x1874211925749632:12345-192.168.203.15@tcp:101:bash.0 Request processed in 235us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388122.932196:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 209 00000100:00100000:1.0:1787388122.935784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388122.936143:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925749760 00000100:00100000:2.0:1787388122.936152:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925749760 00000100:00100000:2.0:1787388122.936208:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:2.0:1787388122.936218:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+7:11937:x1874211925749760:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388122.936234:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388122.936439:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a783a0f1/0x26817551a447523b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80a3 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787388122.936465:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8960d9, atime: 0x6a8960d7, ctime: 0x6a8960d9, blocks: 0x8 00010000:00010000:2.0:1787388122.936487:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1787388122.936491:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388122.936499:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a783a0f1/0x26817551a447523b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80a3 expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.936513:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a783a0f1/0x26817551a447523b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80a3 expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388122.936524:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c600, rc 0) 00000100:00100000:2.0:1787388122.936613:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+8:11937:x1874211925749760:12345-192.168.203.15@tcp:101:bash.0 Request processed in 396us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388122.936620:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:3.0:1787388122.939458:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388122.939688:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925749888 00000100:00100000:1.0:1787388122.939697:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925749888 00002000:00010000:1.0:1787388122.939736:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1787388122.939741:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a43937100 with x1874211925749888 ext(0->18446744073709551615) 00002000:00010000:1.0:1787388122.939753:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996a43937100. 00000100:00100000:1.0:1787388122.939794:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:1.0:1787388122.939814:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925749888:12345-192.168.203.15@tcp:10:bash.0 00002000:00010000:1.0:1787388122.940067:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787388122.940070:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787388121 -> 1787388123 00002000:00010000:1.0:1787388122.940073:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787388119 -> 1787388119 00002000:00010000:1.0:1787388122.940075:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787388121 -> 1787388123 00002000:00010000:1.0:1787388122.940087:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787388122.940148:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:00e97fed-41ea-4716-be07-f037d23906cf+9:2401:x1874211925749888:12345-192.168.203.15@tcp:10:bash.0 Request processed in 345us (698us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787388122.940156:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00002000:00010000:1.0:1787388122.940160:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1787388122.940163:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a43937100 with x1874211925749888 ext(0->18446744073709551615) 00002000:00010000:1.0:1787388122.940168:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996a43937100. 00000100:00100000:1.0:1787388123.019176:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388123.019421:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925750016 00000100:00100000:0.0:1787388123.019430:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925750016 00000100:00100000:0.0:1787388123.019496:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 210 00000100:00100000:0.0:1787388123.019506:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+35:12418:x1874211925750016:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:0.0:1787388123.019577:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4475242 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019593:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4475242 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019604:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4475242 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019619:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475249 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019642:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019649:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019720:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019729:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019735:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388123.019780:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019810:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4475242 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019817:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4475242 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019828:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4475242 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019835:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388123.019839:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4475242 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019847:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4475242 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019866:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:0.0:1787388123.019869:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388123.019874:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4475242 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019888:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031200/0x26817551a4475242 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019900:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019904:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475249 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019908:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475249 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019911:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388123.019912:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475249 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019915:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475249 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019920:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b74d0b000) 00010000:00010000:0.0:1787388123.019921:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388123.019923:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475249 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019926:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475249 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019943:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019947:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019950:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019953:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030c00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388123.019955:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019958:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019962:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:0.0:1787388123.019963:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388123.019964:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.019967:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a4475250 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388123.020049:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+35:12418:x1874211925750016:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 544us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388123.020056:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 210 00000100:00080000:3.0:1787388123.020408:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388123.078894:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388123.078992:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925750272 00000100:00100000:3.0:1787388123.079002:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925750272 00000100:00100000:3.0:1787388123.079061:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 211 00000100:00100000:3.0:1787388123.079072:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+35:12421:x1874211925750272:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388123.079092:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388123.079114:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475257 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80aa expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079223:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447525e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079242:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447525e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079269:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447525e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079286:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475265 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079294:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079301:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079433:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a447526c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079443:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a447526c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079451:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a447526c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388123.079460:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787388123.079537:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447525e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079544:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447525e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079550:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447525e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079560:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388123.079565:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447525e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079572:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447525e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079584:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388123.079587:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388123.079591:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447525e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079597:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a447525e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079609:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079615:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475265 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079621:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079626:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388123.079629:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079635:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475265 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079654:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996a43284900) 00010000:00010000:3.0:1787388123.079656:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388123.079659:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475265 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079670:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475265 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079716:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475257 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80aa expref: 38 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079729:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a447526c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80aa expref: 37 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.079736:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:3.0:1787388123.079738:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787388123.079740:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7e00, rc 0) 00000100:00100000:3.0:1787388123.079820:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+37:12421:x1874211925750272:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 749us (937us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787388123.079827:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 211 00000100:00100000:1.0:1787388123.086538:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388123.087992:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925750400 00000100:00100000:0.0:1787388123.088004:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925750400 00000100:00100000:0.0:1787388123.088952:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 212 00000100:00100000:0.0:1787388123.088979:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+37:12421:x1874211925750400:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:0.0:1787388123.089043:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.089071:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe808e expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.089081:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.089119:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe808e expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.089132:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe808e expref: 37 pid: 6521 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388123.089146:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211945732736:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388123.089249:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a4235a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388123.092282:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874211945732736:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388123.092311:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388123.092726:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388123.092810:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925750656 00000100:00100000:2.0:1787388123.092817:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925750656 00000100:00100000:2.0:1787388123.092869:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:2.0:1787388123.092879:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+38:6169:x1874211925750656:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787388123.093223:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+39:6169:x1874211925750656:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 344us (497us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787388123.093232:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:0.0:1787388123.101065:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388123.102174:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925750784 00000100:00100000:1.0:1787388123.102185:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925750784 00010000:00010000:1.0:1787388123.102229:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe808e expref: 39 pid: 6521 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388123.102271:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 95 00000100:00100000:1.0:1787388123.102280:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+39:2402:x1874211925750784:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388123.102294:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388123.102301:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe808e expref: 39 pid: 6521 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.102314:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe808e expref: 39 pid: 6521 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.102336:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475211 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe808e expref: 39 pid: 6521 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.102403:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:1.0:1787388123.102408:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.102417:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.102424:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.102460:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388123.102637:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+38:2402:x1874211925750784:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 357us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388123.102646:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 95 00010000:00010000:0.0:1787388123.102736:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.102744:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.102783:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.102790:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.102815:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.102821:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388123.102825:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.102833:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.102843:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:0.0:1787388123.102846:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388123.102849:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.102855:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a447527a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388123.102893:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+37:12421:x1874211925750400:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 13918us (16365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388123.102901:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 212 00000100:00100000:1.0:1787388123.109308:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388123.109843:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925751040 00000100:00100000:2.0:1787388123.109853:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925751040 00000100:00100000:2.0:1787388123.109913:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:2.0:1787388123.109924:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+37:12421:x1874211925751040:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388123.110255:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+38:12421:x1874211925751040:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 332us (956us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787388123.110263:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:0.0:1787388123.211640:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388123.211772:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925751296 00000100:00100000:2.0:1787388123.211782:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925751296 00000100:00100000:2.0:1787388123.211852:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 213 00000100:00100000:2.0:1787388123.211863:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+38:12432:x1874211925751296:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:2.0:1787388123.211900:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388123.211921:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475281 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80b1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.211990:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4475288 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212004:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4475288 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212014:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4475288 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212027:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a447528f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212034:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a447528f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212040:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a447528f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212146:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475296 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212154:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212161:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388123.212171:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787388123.212254:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4475288 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212261:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4475288 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212267:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4475288 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212272:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388123.212276:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4475288 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212282:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4475288 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212294:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:2.0:1787388123.212297:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388123.212300:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4475288 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212306:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a4475288 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212318:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a447528f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212324:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a447528f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212329:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a447528f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212333:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388123.212342:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a447528f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212404:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a447528f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212413:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b4900cc00) 00010000:00010000:2.0:1787388123.212415:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388123.212418:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a447528f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212424:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a447528f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212462:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475281 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b1 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212490:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b1 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.212497:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:2.0:1787388123.212500:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388123.212503:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5dc00, rc 0) 00000100:00100000:2.0:1787388123.212854:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+40:12432:x1874211925751296:12345-192.168.203.15@tcp:101:cat.0 Request processed in 992us (1220us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787388123.212862:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 213 00000100:00100000:0.0:1787388123.222084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388123.222244:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925751552 00000100:00100000:3.0:1787388123.222254:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925751552 00000100:00100000:3.0:1787388123.222307:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:3.0:1787388123.222316:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+40:12432:x1874211925751552:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:3.0:1787388123.222826:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+41:12432:x1874211925751552:12345-192.168.203.15@tcp:35:cat.0 Request processed in 508us (747us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787388123.222835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:2.0:1787388123.254087:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388123.254290:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925751808 00000100:00100000:1.0:1787388123.254300:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925751808 00000100:00100000:1.0:1787388123.254383:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 214 00000100:00100000:1.0:1787388123.254393:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+41:12433:x1874211925751808:12345-192.168.203.15@tcp:36:rm.0 00010000:00010000:1.0:1787388123.254446:0:13515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787388123.254479:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475234 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe809c expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254500:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5dc00/0x26817551a4475296 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b1 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254513:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7e00/0x26817551a447526c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80aa expref: 39 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254542:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475226 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8095 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254552:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:1.0:1787388123.254556:0:13515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388123.254577:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44752a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254588:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44752a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254596:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44752a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254609:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254616:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254621:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254701:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a44752b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254710:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a44752b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.254716:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a44752b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388123.254939:0:13515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1787388123.254949:0:13515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444777601645ns, next at 445777599703ns, rc = 0 00010000:00010000:1.0:1787388123.255013:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255022:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255029:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255036:0:13515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255043:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255048:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255070:0:13515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388123.255088:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a44752b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255094:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a44752b2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255100:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a44752b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255105:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388123.255116:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a44752b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255124:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a44752b2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255134:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:1.0:1787388123.255137:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787388123.255140:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a44752b2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255146:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a44752b2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255162:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44752a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255168:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44752a4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.255327:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388123.255333:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.255339:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388123.255342:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.255368:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.255376:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:0.0:1787388123.255379:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787388123.255382:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.255387:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a44752b9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.255397:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388123.255399:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388123.255401:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388123.255728:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44752a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255736:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388123.255740:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44752a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255747:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44752a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255755:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:1.0:1787388123.255758:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388123.255769:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44752a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255775:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44752a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388123.255786:0:13515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f33e3977 reply state 00000000ad3cf008 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255797:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.255815:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b728f7e00) 00010000:00010000:1.0:1787388123.255817:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388123.255820:0:13515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388123.255901:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+39:12433:x1874211925751808:12345-192.168.203.15@tcp:36:rm.0 Request processed in 1507us (1821us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787388123.255910:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 214 00000100:00100000:0.0:1787388123.322816:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388123.323191:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925752064 00000100:00100000:2.0:1787388123.323202:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925752064 00000100:00100000:2.0:1787388123.323262:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 215 00000100:00100000:2.0:1787388123.323286:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+39:12439:x1874211925752064:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388123.323310:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388123.323331:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44752c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.323478:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.323495:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.323506:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.323518:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.323525:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.323531:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787388123.324159:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787388123.324308:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324318:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324328:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324413:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324421:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324427:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324433:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388123.324437:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324443:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324453:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:2.0:1787388123.324456:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388123.324460:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324465:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388123.324477:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048592116 reply state 00000000f8f6d387 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324487:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324492:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b728f7e00) 00010000:00010000:2.0:1787388123.324500:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388123.324503:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787388123.324537:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44752c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b8 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324550:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b8 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.324558:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b4900cc00) 00010000:00010000:2.0:1787388123.324560:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388123.324562:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d800, rc 0) 00000100:00100000:2.0:1787388123.325438:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+42:12439:x1874211925752064:12345-192.168.203.15@tcp:101:bash.0 Request processed in 2150us (2641us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787388123.325447:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 215 00000100:00100000:0.0:1787388123.337816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388123.337908:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925752192 00000100:00100000:1.0:1787388123.337920:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925752192 00000100:00080000:3.0:1787388123.338130:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388123.338926:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:1.0:1787388123.338953:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:2399:x1874211925752192:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388123.338981:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388123.339181:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f0d358e/0x26817551a44752e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80bf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388123.339211:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388123.339234:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787388123.339239:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388123.339248:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f0d358e/0x26817551a44752e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80bf expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.339285:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f0d358e/0x26817551a44752e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80bf expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.339300:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f200, rc 0) 00000100:00100000:1.0:1787388123.339403:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2399:x1874211925752192:12345-192.168.203.15@tcp:101:bash.0 Request processed in 466us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388123.339411:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:1.0:1787388123.344114:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388123.344341:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925752320 00000100:00100000:3.0:1787388123.344439:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925752320 00000100:00100000:3.0:1787388123.344499:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:3.0:1787388123.344510:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+8:12439:x1874211925752320:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1787388123.344528:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388123.344546:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80c6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.344774:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f0d358e/0x26817551a44752e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80bf expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.344786:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388123.344790:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388123.344797:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.344844:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f0d358e/0x26817551a44752e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80bf expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.344857:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f0d358e/0x26817551a44752e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80bf expref: 9 pid: 8434 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388123.344871:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874211945732864:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388123.345023:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388123.351534:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874211945732864:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388123.351596:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.351618:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6600, rc 0) 00000100:00100000:3.0:1787388123.351680:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+9:12439:x1874211925752320:12345-192.168.203.15@tcp:101:bash.0 Request processed in 7171us (7574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388123.351688:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:0.0:1787388123.353251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388123.353343:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925752448 00000100:00100000:2.0:1787388123.353383:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925752448 00010000:00010000:2.0:1787388123.353420:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f0d358e/0x26817551a44752e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80bf expref: 9 pid: 8434 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388123.353461:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 96 00000100:00100000:2.0:1787388123.353470:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+9:2401:x1874211925752448:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388123.353486:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388123.353509:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f0d358e/0x26817551a44752e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80bf expref: 9 pid: 8434 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.353524:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f0d358e/0x26817551a44752e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80bf expref: 9 pid: 8434 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.353569:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f0d358e/0x26817551a44752e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80bf expref: 9 pid: 8434 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.353595:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388123.353606:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388123.353614:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.353623:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.353659:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388123.353675:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1874211945732992:192.168.203.15@tcp:105: 00000100:00100000:2.0:1787388123.353742:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787388123.359341:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388123.359629:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7389c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1874211945732992:192.168.203.15@tcp:105: 00010000:00010000:2.0:1787388123.359654:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388123.359744:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925752448:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 6274us (6499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388123.359757:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 96 00000100:00100000:3.0:1787388123.359877:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925752704 00000100:00100000:3.0:1787388123.359885:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925752704 00000100:00100000:3.0:1787388123.359983:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:3.0:1787388123.359992:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+42:12439:x1874211925752704:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:3.0:1787388123.360251:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+43:12439:x1874211925752704:12345-192.168.203.15@tcp:35:bash.0 Request processed in 260us (920us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787388123.360258:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:2.0:1787388123.373947:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388123.377384:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945733120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388123.377463:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388123.377619:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945733120 00000100:00100000:0.0:1787388123.377628:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945733120 00000100:00100000:0.0:1787388123.377688:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787388123.377698:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7389c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945733120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388123.377731:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787388123.377787:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7389c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945733120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388123.377794:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787388123.377946:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945733120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388123.570765:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388123.572217:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925752832 00000100:00100000:2.0:1787388123.572230:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925752832 00000100:00100000:2.0:1787388123.572437:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 216 00000100:00100000:2.0:1787388123.572447:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+43:12455:x1874211925752832:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388123.572472:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388123.572491:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44752f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80cd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.572592:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.572605:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.572617:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388123.572658:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787388123.572662:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388123.572680:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.572705:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44752f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80cd expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.572721:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80cd expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.572730:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:2.0:1787388123.572744:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388123.572748:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c800, rc 0) 00000100:00100000:2.0:1787388123.573464:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+44:12455:x1874211925752832:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1013us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388123.573474:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 216 00000100:00100000:0.0:1787388123.582153:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388123.582486:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925753088 00000100:00100000:1.0:1787388123.582496:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925753088 00000100:00100000:1.0:1787388123.582551:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 217 00000100:00100000:1.0:1787388123.582561:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+44:12455:x1874211925753088:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388123.582579:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388123.582599:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44752ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80d4 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.582701:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4475306 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.582713:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4475306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.582723:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4475306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388123.582733:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787388123.583029:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44752ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80d4 expref: 47 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.583046:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4475306 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80d4 expref: 46 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.583054:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b4900cc00) 00010000:00010000:1.0:1787388123.583057:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388123.583060:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f200, rc 0) 00000100:00100000:1.0:1787388123.583169:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+46:12455:x1874211925753088:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 610us (1024us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1787388123.583177:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 217 00000100:00100000:1.0:1787388123.593130:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388123.593175:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388123.593286:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925753344 00000100:00100000:2.0:1787388123.593295:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925753344 00000100:00100000:2.0:1787388123.593393:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 218 00000100:00100000:2.0:1787388123.593403:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a41c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+46:12455:x1874211925753344:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388123.593429:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388123.593450:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475314 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80db expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.593559:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a447531b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.593574:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a447531b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.593585:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a447531b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388123.593598:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787388123.593713:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475314 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80db expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.593730:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a447531b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80db expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.593756:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b4900cc00) 00010000:00010000:2.0:1787388123.593759:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787388123.593762:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c400, rc 0) 00000100:00100000:2.0:1787388123.593840:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a41c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+48:12455:x1874211925753344:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 436us (718us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1787388123.593850:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 218 00000100:00100000:0.0:1787388123.594863:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925753472 00000100:00100000:0.0:1787388123.594882:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925753472 00000100:00100000:0.0:1787388123.594939:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:0.0:1787388123.594949:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+48:2401:x1874211925753472:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388123.594961:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388123.594987:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f200/0x26817551a4475306 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80d4 expref: 48 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.595003:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b4900cc00) 00010000:00010000:0.0:1787388123.595019:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388123.595073:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+47:2401:x1874211925753472:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 118us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388123.595081:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:1.0:1787388123.602681:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388123.602764:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925753600 00000100:00100000:2.0:1787388123.602774:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925753600 00000100:00100000:2.0:1787388123.602840:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:2.0:1787388123.602851:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925753600:12345-192.168.203.15@tcp:1:lfs.0 00010000:00010000:2.0:1787388123.602895:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.602914:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.602922:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787388123.602926:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388123.602931:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.602966:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388123.602991:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 8 pid: 8437 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388123.603025:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4404bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874211945733248:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388123.603324:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787388123.615151:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388123.615385:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925753728 00000100:00100000:1.0:1787388123.615394:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925753728 00002000:00100000:1.0:1787388123.615443:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff996a4404a680 x1874211925753728/t0(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:379/0 lens 504/0 e 0 to 0 dl 1787388134 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388123.615456:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a4404a680 with x1874211925753728 ext(0->8) 00010000:00010000:1.0:1787388123.615465:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 9 pid: 8437 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.615480:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 9 pid: 8437 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388123.615489:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996a4404a680 00000100:00100000:1.0:1787388123.615533:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:1.0:1787388123.615542:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+9:2401:x1874211925753728:12345-192.168.203.15@tcp:4:lfs.0 00000100:00100000:1.0:1787388123.616578:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+11:2401:x1874211925753728:12345-192.168.203.15@tcp:4:lfs.0 Request processed in 1033us (1430us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787388123.616587:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00002000:00100000:1.0:1787388123.616596:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff996a4404a680 x1874211925753728/t4294967309(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:379/0 lens 504/448 e 0 to 0 dl 1787388134 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388123.616606:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a4404a680 with x1874211925753728 ext(0->8) 00010000:00010000:1.0:1787388123.616613:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 11 pid: 8437 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.616699:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 11 pid: 8437 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388123.616715:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996a4404a680 00000100:00100000:0.0:1787388123.616796:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4404bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874211945733248:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388123.616830:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388123.622520:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388123.623005:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925753856 00000100:00100000:1.0:1787388123.623015:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925753856 00010000:00010000:1.0:1787388123.623058:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 11 pid: 8437 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388123.623119:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 97 00000100:00100000:1.0:1787388123.623129:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+11:2402:x1874211925753856:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388123.623143:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787388123.623161:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787388123.623163:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787388123 00002000:00010000:1.0:1787388123.623177:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787388124 00002000:00010000:1.0:1787388123.623179:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787388123 00002000:00010000:1.0:1787388123.623181:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787388123.623188:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 11 pid: 8437 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.623202:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 11 pid: 8437 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.623229:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44752ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80c6 expref: 11 pid: 8437 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.623245:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388123.623250:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388123.623255:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.623266:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.623301:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388123.623521:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.623530:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.623549:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.623568:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.623575:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.623582:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388123.623587:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.623595:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.623606:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.623612:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002313aa40/0x26817551a4475329 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388123.623685:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+10:2401:x1874211925753600:12345-192.168.203.15@tcp:1:lfs.0 Request processed in 20835us (21012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388123.623694:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:1.0:1787388123.624642:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+9:2402:x1874211925753856:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 1508us (2129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388123.624652:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 97 00000100:00100000:0.0:1787388123.627166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388123.627291:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925754112 00000100:00100000:1.0:1787388123.627302:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925754112 00000100:00100000:1.0:1787388123.627390:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:1.0:1787388123.627401:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dcc8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+47:12455:x1874211925754112:12345-192.168.203.15@tcp:35:lfs.0 00000004:00010000:1.0:1787388123.627473:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a447531b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80db expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388123.627667:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1787388123.627706:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787388123.628292:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1787388123.628335:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.629992:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b8 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.630002:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.630051:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b8 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.630078:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b8 expref: 51 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388123.630095:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874211945733376:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388123.630198:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42260840 going to sleep for 11 seconds 00000100:00100000:2.0:1787388123.635394:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388123.635707:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925754240 00000100:00100000:0.0:1787388123.635717:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925754240 00010000:00010000:0.0:1787388123.635768:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b8 expref: 52 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388123.635823:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 98 00000100:00100000:0.0:1787388123.635833:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4404bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+52:2402:x1874211925754240:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388123.635848:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388123.635854:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b8 expref: 52 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.635867:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b8 expref: 52 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.635889:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b4900cc00) 00010000:00010000:0.0:1787388123.635894:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.635903:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.635909:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.635928:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388123.635992:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4404bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+52:2402:x1874211925754240:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 160us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388123.636000:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 98 00010000:00010000:1.0:1787388123.638068:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44752d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80b8 expref: 51 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388123.638092:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874211945733376:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388123.638120:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.638143:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.638149:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388123.638260:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1787388123.638426:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1787388123.638518:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945733504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787388123.639392:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388123.639421:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422609c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388123.640458:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945733504 00000100:00100000:0.0:1787388123.640470:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945733504 00000100:00100000:0.0:1787388123.640534:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787388123.640557:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1874211945733504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787388123.640684:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1874211945733504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 130us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388123.640692:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787388123.641520:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945733504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787388123.641671:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1787388123.641759:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945733632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787388123.641815:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388123.641925:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945733632 00000100:00100000:3.0:1787388123.641933:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945733632 00000100:00100000:3.0:1787388123.641964:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787388123.642059:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42260300 going to sleep for 11 seconds 00000100:00100000:3.0:1787388123.642199:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1874211945733632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787388123.642316:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6523:x1874211945733632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (500us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787388123.642324:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787388123.642599:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874211945733632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787388123.642648:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1787388123.642685:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.642694:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.642701:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.642707:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388123.642725:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.642732:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.642746:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b4900cc00) 00010000:00010000:1.0:1787388123.642749:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787388123.642753:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.642758:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475330 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787388123.643447:0:6523:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787388123.643517:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787388123.643529:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 445166181554ns, next at 446166179264ns, rc = 0 00000001:00080000:1.0:1787388123.643536:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1787388123.643569:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b4900cc00) 00010000:00010000:1.0:1787388123.643573:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787388123.643580:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c400/0x26817551a447531b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80db expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388123.643681:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dcc8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+54:12455:x1874211925754112:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 16282us (16522us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787388123.643689:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00000020:00080000:1.0:1787388123.643694:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787388123.651583:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388123.651656:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925754368 00000100:00100000:0.0:1787388123.651666:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925754368 00000100:00100000:0.0:1787388123.651729:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 219 00000100:00100000:0.0:1787388123.651739:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+54:12455:x1874211925754368:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388123.651763:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388123.651785:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475337 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80e2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.651852:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475337 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80e2 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.651866:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475337 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80e2 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.651886:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:0.0:1787388123.651889:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787388123.651892:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031a00, rc 0) 00000100:00100000:0.0:1787388123.651954:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+55:12455:x1874211925754368:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 216us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388123.651962:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 219 00000100:00100000:2.0:1787388123.657261:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388123.657342:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925754624 00000100:00100000:3.0:1787388123.657381:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925754624 00000100:00100000:3.0:1787388123.657434:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:3.0:1787388123.657445:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+55:12455:x1874211925754624:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1787388123.657698:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+56:12455:x1874211925754624:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 253us (445us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787388123.657720:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00010000:00010000:1.0:1787388123.756806:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388123.775260:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388123.775593:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925754752 00000100:00100000:3.0:1787388123.775604:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925754752 00000100:00100000:3.0:1787388123.775663:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 220 00000100:00100000:3.0:1787388123.775673:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+56:12465:x1874211925754752:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:3.0:1787388123.775751:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a447533e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.775768:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a447533e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.775782:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a447533e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.775794:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475345 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.775811:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.775818:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.775894:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.775902:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.775909:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388123.776450:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776467:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a447533e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776474:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a447533e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776480:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a447533e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776485:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388123.776489:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a447533e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776501:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a447533e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776514:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388123.776517:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388123.776521:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a447533e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776527:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a447533e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776541:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776548:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475345 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776562:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776567:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388123.776570:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776577:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475345 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776586:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b728f7e00) 00010000:00010000:3.0:1787388123.776588:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388123.776591:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475345 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776597:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475345 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776607:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776613:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776618:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776623:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388123.776626:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776643:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776651:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:3.0:1787388123.776653:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388123.776656:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388123.776661:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447534c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388123.776745:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+56:12465:x1874211925754752:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 1071us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388123.776754:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 220 00000100:00100000:2.0:1787388123.855811:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388123.855918:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925755008 00000100:00100000:1.0:1787388123.855941:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925755008 00000100:00100000:1.0:1787388123.856010:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 221 00000100:00100000:1.0:1787388123.856020:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd72050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+56:12468:x1874211925755008:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388123.856039:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388123.856071:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475353 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856144:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a447535a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856159:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a447535a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856170:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a447535a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856179:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475361 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856186:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856192:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856305:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475368 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856314:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856321:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388123.856339:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787388123.856448:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a447535a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856456:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a447535a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856463:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a447535a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856469:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388123.856473:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a447535a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856481:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a447535a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856494:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:1.0:1787388123.856497:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388123.856502:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a447535a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856508:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a447535a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856521:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856527:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475361 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856543:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475361 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856548:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388123.856550:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475361 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856556:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475361 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856564:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b728f7e00) 00010000:00010000:1.0:1787388123.856566:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388123.856569:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475361 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856575:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475361 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856610:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a4475353 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80e9 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856623:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80e9 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388123.856629:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388123.856631:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388123.856634:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f600, rc 0) 00000100:00100000:1.0:1787388123.856700:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd72050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+58:12468:x1874211925755008:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 681us (905us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787388123.856717:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 221 00000100:00100000:3.0:1787388123.870178:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388123.870286:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925755136 00000100:00100000:0.0:1787388123.870296:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925755136 00000100:00100000:0.0:1787388123.870390:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 222 00000100:00100000:0.0:1787388123.870412:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+58:12468:x1874211925755136:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:0.0:1787388123.870480:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475376 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.870497:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475376 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.870510:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475376 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.870545:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475376 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.870552:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475376 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.870559:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475376 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.870565:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388123.870569:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475376 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.870577:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475376 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.870587:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:0.0:1787388123.870590:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388123.870593:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475376 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388123.870598:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a4475376 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388123.870674:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+58:12468:x1874211925755136:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 262us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388123.870682:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 222 00000100:00100000:3.0:1787388123.873044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388123.873161:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925755392 00000100:00100000:1.0:1787388123.873171:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925755392 00000100:00100000:1.0:1787388123.873223:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:1.0:1787388123.873233:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+58:12468:x1874211925755392:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:1.0:1787388123.873490:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+59:12468:x1874211925755392:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 257us (452us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1787388123.873498:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:3.0:1787388124.002544:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.002714:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925755648 00000100:00100000:1.0:1787388124.002734:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925755648 00000100:00100000:1.0:1787388124.002858:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 223 00000100:00100000:1.0:1787388124.002870:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+59:12479:x1874211925755648:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388124.002895:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388124.002898:0:13515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787388124.002926:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c800/0x26817551a44752f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80cd expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.002944:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:1.0:1787388124.002949:0:13515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388124.002962:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a447537d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80f0 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.003069:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.003083:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.003105:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388124.003117:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787388124.003216:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a447537d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f0 expref: 61 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.003231:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f0 expref: 60 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.003238:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388124.003241:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388124.003244:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e800, rc 0) 00000100:00100000:1.0:1787388124.003304:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+60:12479:x1874211925755648:12345-192.168.203.15@tcp:101:bash.0 Request processed in 435us (769us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787388124.003312:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 223 00000100:00100000:0.0:1787388124.013545:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.013642:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925755776 00000100:00100000:1.0:1787388124.013651:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925755776 00000100:00100000:1.0:1787388124.013716:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 224 00000100:00100000:1.0:1787388124.013735:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+60:12479:x1874211925755776:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388124.013758:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388124.013778:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475392 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.013823:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.013853:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.013864:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.014088:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475392 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f7 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.014109:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f7 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.014117:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388124.014120:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388124.014123:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e000, rc 0) 00000100:00100000:1.0:1787388124.014184:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+61:12479:x1874211925755776:12345-192.168.203.15@tcp:101:bash.0 Request processed in 451us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.014192:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 224 00000100:00100000:3.0:1787388124.016096:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.016182:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925755904 00000100:00100000:2.0:1787388124.016191:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925755904 00000100:00100000:2.0:1787388124.016249:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:2.0:1787388124.016259:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+61:2402:x1874211925755904:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388124.016272:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388124.016295:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e800/0x26817551a4475384 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f0 expref: 61 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.016313:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:2.0:1787388124.016317:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388124.016396:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+60:2402:x1874211925755904:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 139us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.016403:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:3.0:1787388124.017767:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.017894:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925756160 00000100:00100000:1.0:1787388124.017908:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925756160 00000100:00100000:1.0:1787388124.017954:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 225 00000100:00100000:1.0:1787388124.017971:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+60:12479:x1874211925756160:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:1.0:1787388124.018018:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388124.018039:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a4475368 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80e9 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.018056:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388124.018071:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388124.018238:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.018251:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.018261:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388124.018304:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1787388124.018324:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029c0aa34 reply state 000000001e668d22 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.018336:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.018342:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388124.018381:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388124.018385:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388124.018470:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+62:12479:x1874211925756160:12345-192.168.203.15@tcp:36:bash.0 Request processed in 505us (705us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787388124.018477:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 225 00000020:00080000:1.0:1787388124.018482:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787388124.028425:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.028514:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925756288 00000100:00100000:1.0:1787388124.028524:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925756288 00000100:00100000:1.0:1787388124.028598:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 226 00000100:00100000:1.0:1787388124.028608:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+62:12479:x1874211925756288:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388124.028630:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388124.028651:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe80fe expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.028787:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.028809:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.028820:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388124.028852:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787388124.028856:0:13515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388124.028874:0:13515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.028902:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80fe expref: 64 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.028917:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80fe expref: 63 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.028926:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388124.028929:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388124.028932:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e400, rc 0) 00000100:00100000:1.0:1787388124.029007:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+63:12479:x1874211925756288:12345-192.168.203.15@tcp:101:bash.0 Request processed in 400us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.029014:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 226 00000100:00100000:3.0:1787388124.041866:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.041966:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925756544 00000100:00100000:1.0:1787388124.041986:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925756544 00000100:00100000:1.0:1787388124.042061:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:1.0:1787388124.042070:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+63:12479:x1874211925756544:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:1.0:1787388124.042287:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+64:12479:x1874211925756544:12345-192.168.203.15@tcp:35:bash.0 Request processed in 218us (428us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1787388124.042294:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:2.0:1787388124.138703:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388124.138782:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925756672 00000100:00100000:0.0:1787388124.138792:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925756672 00000100:00100000:0.0:1787388124.138865:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 227 00000100:00100000:0.0:1787388124.138874:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+64:12485:x1874211925756672:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388124.138894:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388124.138913:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44753b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8105 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.138973:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44753bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.138986:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44753bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.138997:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44753bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388124.139039:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787388124.139042:0:10197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388124.139058:0:10197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44753bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.139092:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44753b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8105 expref: 66 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.139128:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44753bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8105 expref: 65 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.139136:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:0.0:1787388124.139139:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388124.139142:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030000, rc 0) 00000100:00100000:0.0:1787388124.139198:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+65:12485:x1874211925756672:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 325us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.139205:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 227 00000100:00100000:0.0:1787388124.144557:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.144652:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925756800 00000100:00100000:2.0:1787388124.144662:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925756800 00000100:00100000:2.0:1787388124.144719:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 228 00000100:00100000:2.0:1787388124.144729:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+65:12485:x1874211925756800:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388124.144760:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388124.144780:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44753c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe810c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.144851:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44753ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.144866:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44753ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.144877:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44753ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.144888:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a44753d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.144895:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a44753d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.144901:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a44753d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.144982:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44753d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.144991:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44753d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.144998:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44753d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388124.145041:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787388124.145051:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388124.145083:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44753d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145097:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44753d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145106:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44753ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145111:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44753ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145117:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44753ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145123:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.145127:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44753ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145134:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44753ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145146:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:2.0:1787388124.145149:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.145154:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44753ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145160:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44753ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145173:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a44753d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145189:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a44753d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145195:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a44753d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145200:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5ca00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.145202:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a44753d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145208:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a44753d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145216:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b728f7e00) 00010000:00010000:2.0:1787388124.145219:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.145222:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a44753d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145227:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a44753d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145254:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a44753c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe810c expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145266:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44753d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe810c expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.145272:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:2.0:1787388124.145274:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388124.145281:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d600, rc 0) 00000100:00100000:2.0:1787388124.145385:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+66:12485:x1874211925756800:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 616us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.145394:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 228 00000100:00100000:3.0:1787388124.151878:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388124.156314:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.156504:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925757184 00000100:00100000:2.0:1787388124.156514:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925757184 00000100:00100000:2.0:1787388124.156585:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1787388124.156596:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+66:2401:x1874211925757184:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388124.156610:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388124.156636:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a44753d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe810c expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.156655:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:2.0:1787388124.156659:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388124.156711:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+65:2401:x1874211925757184:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 117us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.156718:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:1.0:1787388124.160035:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925757056 00000100:00100000:1.0:1787388124.160049:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925757056 00000100:00100000:1.0:1787388124.160180:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 229 00000100:00100000:1.0:1787388124.160202:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+65:12485:x1874211925757056:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388124.160222:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388124.160252:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753df lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8113 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.160388:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.160404:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80fe expref: 66 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.160413:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.160447:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80fe expref: 66 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.160461:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80fe expref: 66 pid: 13515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388124.160507:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945733760:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388124.160608:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42260180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388124.166506:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.166882:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925757312 00000100:00100000:2.0:1787388124.166891:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925757312 00010000:00010000:2.0:1787388124.166929:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80fe expref: 67 pid: 13515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.166981:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 99 00000100:00100000:2.0:1787388124.166991:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+67:2402:x1874211925757312:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388124.167004:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388124.167011:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80fe expref: 67 pid: 13515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.167043:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80fe expref: 67 pid: 13515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.167068:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:2.0:1787388124.167073:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.167082:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.167089:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.167114:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388124.167272:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80fe expref: 67 pid: 13515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388124.167289:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874211945733760:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388124.167310:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.167319:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.167325:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388124.167341:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787388124.167512:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753df lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8113 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.167526:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8113 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.167532:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388124.167535:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388124.167537:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f600, rc 0) 00000100:00100000:2.0:1787388124.167602:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+67:2402:x1874211925757312:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 612us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.167623:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 99 00000100:00100000:1.0:1787388124.169081:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+66:12485:x1874211925757056:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 8875us (17195us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787388124.169104:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 229 00000100:00100000:0.0:1787388124.172300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.172578:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925757568 00000100:00100000:2.0:1787388124.172588:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925757568 00000100:00100000:2.0:1787388124.172661:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:2.0:1787388124.172671:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+66:12485:x1874211925757568:12345-192.168.203.15@tcp:103:lfs.0 00010000:00010000:2.0:1787388124.172687:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388124.172717:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a4475337 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80e2 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.172735:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:2.0:1787388124.172740:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388124.172813:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+65:12485:x1874211925757568:12345-192.168.203.15@tcp:103:lfs.0 Request processed in 143us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.172822:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:3.0:1787388124.177394:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.177530:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925757696 00000100:00100000:1.0:1787388124.177539:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925757696 00000100:00100000:1.0:1787388124.177600:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 230 00000100:00100000:1.0:1787388124.177615:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+65:12485:x1874211925757696:12345-192.168.203.15@tcp:58:lfs.0 00010000:00010000:1.0:1787388124.177719:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.177735:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.177746:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388124.177850:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787388124.177932:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+65:12485:x1874211925757696:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 323us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.177941:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 230 00000100:00100000:0.0:1787388124.181071:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.181432:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925757824 00000100:00100000:1.0:1787388124.181441:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925757824 00000100:00100000:1.0:1787388124.181497:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 231 00000100:00100000:1.0:1787388124.181507:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+65:12485:x1874211925757824:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388124.181527:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388124.181546:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe811a expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.181601:0:13515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.181629:0:13515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753fb lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe811a expref: 66 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.181648:0:13515:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.181663:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753fb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe811a expref: 66 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.181679:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388124.181682:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388124.181686:0:13515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753fb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe811a expref: 66 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.181695:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4e400, rc 0) 00000100:00100000:1.0:1787388124.181759:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+66:12485:x1874211925757824:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 254us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.181767:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 231 00000040:00080000:3.0:1787388124.205451:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388124.205460:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388124.205510:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787388124.205518:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787388124.205653:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945733888:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787388124.207884:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b45338240 going to sleep for 11 seconds 00000100:00100000:0.0:1787388124.213519:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.213618:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945733888:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787388124.214128:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925757952 00000100:00100000:1.0:1787388124.214135:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925757952 00000100:00100000:1.0:1787388124.214185:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 232 00000100:00100000:1.0:1787388124.214194:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+66:12486:x1874211925757952:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787388124.214228:0:6520:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787388124.214379:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+66:12486:x1874211925757952:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 185us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.214387:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 232 00000100:00100000:0.0:1787388124.220116:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.220185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925758080 00000100:00100000:2.0:1787388124.220195:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925758080 00000100:00100000:2.0:1787388124.220257:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 233 00000100:00100000:2.0:1787388124.220267:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+66:12486:x1874211925758080:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787388124.220338:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475402 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220400:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475402 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220412:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475402 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220469:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4475409 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220478:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4475409 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220484:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4475409 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220508:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220516:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220523:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388124.220599:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787388124.220604:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388124.220617:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220627:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475402 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220632:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475402 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220638:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475402 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220643:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.220647:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475402 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220654:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475402 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220665:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:2.0:1787388124.220667:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.220671:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475402 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220676:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d600/0x26817551a4475402 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220701:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4475409 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220718:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4475409 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220734:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4475409 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220740:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.220744:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4475409 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220749:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4475409 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220758:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff996b4900ca00) 00010000:00010000:2.0:1787388124.220760:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.220762:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4475409 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220768:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d800/0x26817551a4475409 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220790:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220804:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220809:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220814:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5ca00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.220823:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220830:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220838:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:2.0:1787388124.220840:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.220843:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.220849:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ca00/0x26817551a4475410 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.220928:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+66:12486:x1874211925758080:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 662us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.220935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 233 00000100:00100000:3.0:1787388124.229893:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.230257:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925758336 00000100:00100000:1.0:1787388124.230267:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925758336 00000100:00100000:1.0:1787388124.230331:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 234 00000100:00100000:1.0:1787388124.230388:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+66:12486:x1874211925758336:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388124.230409:0:13515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388124.230429:0:13515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4475417 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8121 expref: -99 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230533:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a447541e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230548:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a447541e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230559:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a447541e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388124.230570:0:13515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787388124.230657:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a447541e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230665:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a447541e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230671:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a447541e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230676:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4ea00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388124.230681:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a447541e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230688:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a447541e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230714:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388124.230717:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787388124.230721:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a447541e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230727:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ea00/0x26817551a447541e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230763:0:13515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4475417 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8121 expref: 68 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230772:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:1.0:1787388124.230774:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388124.230877:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fa00/0x26817551a4475417 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8121 expref: 68 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.230891:0:13515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fa00, rc 0) 00000100:00100000:1.0:1787388124.230950:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+67:12486:x1874211925758336:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 610us (1065us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1787388124.230957:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 234 00000100:00100000:0.0:1787388124.238037:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.238251:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925758464 00000100:00100000:2.0:1787388124.238261:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925758464 00000100:00100000:2.0:1787388124.238325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 235 00000100:00100000:2.0:1787388124.238334:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+67:12486:x1874211925758464:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787388124.238412:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787388124.241261:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+67:12486:x1874211925758464:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 2919us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.241275:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 235 00000100:00100000:2.0:1787388124.249555:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.249872:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925758720 00000100:00100000:3.0:1787388124.249881:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925758720 00000100:00100000:3.0:1787388124.249993:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 236 00000100:00100000:3.0:1787388124.250003:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+67:12486:x1874211925758720:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388124.250023:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388124.250026:0:10197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787388124.250052:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44753bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8105 expref: 67 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.250080:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388124.250085:0:10197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388124.250099:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447542c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8128 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787388124.251643:0:10197:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:3.0:1787388124.252461:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475433 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.252478:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475433 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.252489:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475433 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.252624:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a447542c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8128 expref: 69 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.252662:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475433 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8128 expref: 68 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.252671:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996a43284900) 00010000:00010000:3.0:1787388124.252674:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388124.252678:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6800, rc 0) 00000100:00100000:3.0:1787388124.253050:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+68:12486:x1874211925758720:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 3047us (3502us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787388124.253059:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 236 00000100:00100000:2.0:1787388124.259431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.259747:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925758976 00000100:00100000:3.0:1787388124.259757:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925758976 00000100:00100000:3.0:1787388124.259832:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 237 00000100:00100000:3.0:1787388124.259842:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+68:12486:x1874211925758976:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787388124.259897:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388124.259923:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475433 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8128 expref: 68 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.259939:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996a43284900) 00010000:00010000:3.0:1787388124.259950:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388124.260137:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475441 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260152:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260173:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260240:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475448 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xf2a9e60e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260249:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475448 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf2a9e60e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260256:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475448 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf2a9e60e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260301:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260309:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475441 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260315:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260321:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388124.260325:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260333:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475441 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260383:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:3.0:1787388124.260387:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388124.260391:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475441 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260398:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475441 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260417:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475448 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf2a9e60e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260424:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475448 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf2a9e60e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260430:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475448 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf2a9e60e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260435:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388124.260438:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475448 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf2a9e60e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260445:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475448 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf2a9e60e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260454:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xf2a9e60e (ffff996a43284e00) 00010000:00010000:3.0:1787388124.260456:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388124.260459:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475448 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf2a9e60e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.260465:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475448 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf2a9e60e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388124.260657:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+67:12486:x1874211925758976:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 815us (1233us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787388124.260666:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 237 00000100:00100000:0.0:1787388124.264661:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.264753:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925759104 00000100:00100000:2.0:1787388124.264762:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925759104 00000100:00100000:2.0:1787388124.264945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 238 00000100:00100000:2.0:1787388124.264957:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+67:12486:x1874211925759104:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388124.264987:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388124.265010:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a447544f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe812f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.265044:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.265055:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.265066:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.265176:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a447544f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe812f expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.265192:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe812f expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.265201:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:2.0:1787388124.265205:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787388124.265209:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5cc00, rc 0) 00000100:00100000:2.0:1787388124.265307:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+68:12486:x1874211925759104:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 353us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.265315:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 238 00000100:00100000:0.0:1787388124.269534:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.269711:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925759360 00000100:00100000:3.0:1787388124.269720:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925759360 00000100:00100000:2.0:1787388124.269900:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 239 00000100:00100000:2.0:1787388124.269912:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+68:12486:x1874211925759360:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388124.270073:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.270089:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.270100:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388124.270254:0:10197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787388124.270264:0:10197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445792916168ns, next at 446792913985ns, rc = 0 00000004:00010000:2.0:1787388124.270310:0:10197:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000644b4400 reply state 00000000ae1efa90 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.270324:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.270331:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:2.0:1787388124.270333:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787388124.270337:0:10197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388124.270618:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+70:12486:x1874211925759360:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 707us (1092us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787388124.270627:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 239 00000100:00100000:2.0:1787388124.273674:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.273812:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925759488 00000100:00100000:3.0:1787388124.273835:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925759488 00000100:00100000:3.0:1787388124.273882:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 240 00000100:00100000:3.0:1787388124.273891:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+70:12486:x1874211925759488:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388124.273910:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388124.273928:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4475464 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8136 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.273994:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4475464 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8136 expref: 71 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.274008:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4475464 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8136 expref: 71 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.274026:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:3.0:1787388124.274029:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787388124.274032:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7200, rc 0) 00000100:00100000:3.0:1787388124.274090:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+71:12486:x1874211925759488:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 201us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388124.274097:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 240 00000100:00100000:3.0:1787388124.278198:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.278283:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925759616 00000100:00100000:2.0:1787388124.278294:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925759616 00000100:00100000:2.0:1787388124.278403:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:2.0:1787388124.278415:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+9:2399:x1874211925759616:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787388124.278624:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+10:2399:x1874211925759616:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 212us (438us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787388124.278645:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00080000:3.0:1787388124.279312:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388124.285547:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.285647:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925759872 00000100:00100000:1.0:1787388124.285656:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925759872 00000100:00100000:1.0:1787388124.285711:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:1.0:1787388124.285721:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+71:12486:x1874211925759872:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787388124.285958:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+72:12486:x1874211925759872:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 238us (419us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1787388124.285993:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:1.0:1787388124.293275:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.293384:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925760128 00000100:00100000:2.0:1787388124.293394:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925760128 00000100:00100000:2.0:1787388124.293455:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 241 00000100:00100000:2.0:1787388124.293465:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+72:12486:x1874211925760128:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787388124.294054:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+72:12486:x1874211925760128:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 588us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.294062:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 241 00000100:00100000:0.0:1787388124.299902:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.300013:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925760256 00000100:00100000:2.0:1787388124.300023:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925760256 00000100:00100000:2.0:1787388124.300084:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 242 00000100:00100000:2.0:1787388124.300094:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+72:12486:x1874211925760256:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388124.300114:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388124.300137:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a447546b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe813d expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.300208:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4475472 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.300222:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4475472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.300233:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4475472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388124.300277:0:10197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388124.300308:0:10197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4475472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.300333:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a447546b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe813d expref: 74 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.300396:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4475472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe813d expref: 73 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.300406:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:2.0:1787388124.300409:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787388124.300412:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5de00, rc 0) 00000100:00100000:2.0:1787388124.300473:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+73:12486:x1874211925760256:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 379us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.300481:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 242 00000100:00100000:1.0:1787388124.305637:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.306957:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925760384 00000100:00100000:2.0:1787388124.306978:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925760384 00000100:00100000:2.0:1787388124.307043:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:2.0:1787388124.307054:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+10:2402:x1874211925760384:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388124.307073:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388124.307092:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475479 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8144 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787388124.307119:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8960dc, blocks: 0x0 00010000:00010000:2.0:1787388124.307139:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787388124.307144:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388124.307154:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8144 expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.307192:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8144 expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.307206:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5dc00, rc 0) 00000100:00100000:2.0:1787388124.307275:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+11:2402:x1874211925760384:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 222us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.307282:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:1.0:1787388124.313147:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.313225:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925760640 00000100:00100000:3.0:1787388124.313236:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925760640 00000100:00100000:3.0:1787388124.313297:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 243 00000100:00100000:3.0:1787388124.313307:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+73:12486:x1874211925760640:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787388124.313457:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+73:12486:x1874211925760640:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 152us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388124.313484:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 243 00000100:00100000:3.0:1787388124.318150:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.318254:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925760768 00000100:00100000:2.0:1787388124.318264:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925760768 00000100:00100000:2.0:1787388124.318325:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:2.0:1787388124.318336:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+11:12486:x1874211925760768:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388124.318411:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388124.318431:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe814b expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.318464:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475479 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8144 expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.318474:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388124.318478:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388124.318484:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.318519:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8144 expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.318548:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475479 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8144 expref: 12 pid: 8434 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.318565:0:8490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874211945734016:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388124.318665:0:8490:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388124.323922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388124.324022:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925760896 00000100:00100000:0.0:1787388124.324031:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925760896 00010000:00010000:0.0:1787388124.324069:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475479 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8144 expref: 13 pid: 8434 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388124.324108:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 100 00000100:00100000:0.0:1787388124.324131:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+13:2402:x1874211925760896:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388124.324147:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388124.324171:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475479 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8144 expref: 13 pid: 8434 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.324186:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475479 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8144 expref: 13 pid: 8434 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.324212:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388124.324217:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388124.324225:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 13 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.324235:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 13 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.324271:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 13 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388124.324285:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1874211945734144:192.168.203.15@tcp:105: 00000100:00100000:0.0:1787388124.324396:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a4235acc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787388124.325107:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475479 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8144 expref: 13 pid: 8434 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.325125:0:8490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874211945734016:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388124.325149:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.325160:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d000, rc 0) 00000100:00100000:2.0:1787388124.325207:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+12:12486:x1874211925760768:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 6873us (7066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.325215:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:0.0:1787388124.328418:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1874211945734144:192.168.203.15@tcp:105: 00010000:00010000:0.0:1787388124.328445:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388124.328495:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+11:2402:x1874211925760896:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 4365us (4581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.328522:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 100 00000100:00100000:3.0:1787388124.333832:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388124.334103:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925761024 00000100:00100000:0.0:1787388124.334113:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925761024 00002000:00100000:0.0:1787388124.334162:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff996a43937800 x1874211925761024/t0(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:380/0 lens 504/0 e 0 to 0 dl 1787388135 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388124.334172:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a43937800 with x1874211925761024 ext(0->12) 00002000:00010000:0.0:1787388124.334178:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996a43937800 00000100:00100000:0.0:1787388124.334212:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1787388124.334221:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00e97fed-41ea-4716-be07-f037d23906cf+11:2402:x1874211925761024:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787388124.336246:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00e97fed-41ea-4716-be07-f037d23906cf+13:2402:x1874211925761024:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 Request processed in 2016us (2413us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787388124.336260:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00002000:00100000:0.0:1787388124.336272:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff996a43937800 x1874211925761024/t4294967321(0) o4->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:380/0 lens 504/448 e 0 to 0 dl 1787388135 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787388124.336282:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a43937800 with x1874211925761024 ext(0->12) 00002000:00010000:0.0:1787388124.336288:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996a43937800 00000100:00100000:0.0:1787388124.340251:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.340940:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925761152 00000100:00100000:2.0:1787388124.340951:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925761152 00000100:00100000:2.0:1787388124.341118:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 244 00000100:00100000:2.0:1787388124.341128:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+73:12486:x1874211925761152:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787388124.343064:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1787388124.343081:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1787388124.343116:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787388124.343132:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996a422609c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787388124.343137:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b5dcf9f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996a422600c0 00000020:00080000:3.0:1787388124.343140:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b43200200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996b620d3a00 00000004:00080000:3.0:1787388124.343163:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787388124.343189:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996a422a4240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787388124.343193:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b45051c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996a422a4540 00000020:00080000:3.0:1787388124.343196:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b45051600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996a43298600 00000020:00080000:3.0:1787388124.343205:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:2.0:1787388124.343309:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343321:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343368:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343375:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.343381:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343389:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343405:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff996b74d0bb00) 00010000:00010000:2.0:1787388124.343408:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.343413:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343420:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475185 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343452:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343458:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343464:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343469:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5ce00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.343472:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343487:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343496:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff996b74d0ba00) 00010000:00010000:2.0:1787388124.343498:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.343501:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343507:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5ce00/0x26817551a447522d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343524:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343530:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343536:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343541:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.343544:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343550:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343557:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b728f7e00) 00010000:00010000:2.0:1787388124.343559:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.343562:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343724:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f400/0x26817551a44752ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343739:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343744:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343750:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343754:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.343757:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343762:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343770:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b728f7e00) 00010000:00010000:2.0:1787388124.343773:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.343775:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343906:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d400/0x26817551a44752ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343935:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343942:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343954:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.343960:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.344074:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.344083:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.344091:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:2.0:1787388124.344094:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.344096:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.344102:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f000/0x26817551a44753a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.344113:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.344118:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.344123:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.344129:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5c200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.344131:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.344148:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.344157:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:2.0:1787388124.344159:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787388124.344162:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.344168:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5c200/0x26817551a447545d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.344314:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+21:12486:x1874211925761152:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 3182us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.344323:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 244 00000100:00100000:1.0:1787388124.344665:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945734528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787388124.345040:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388124.345080:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388124.345086:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945734400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787388124.345111:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388124.345137:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388124.345145:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945734272:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787388124.345168:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388124.345197:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945734528 00000100:00100000:1.0:1787388124.345203:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945734528 00000100:00100000:1.0:1787388124.345249:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945734400 00000100:00100000:1.0:1787388124.345253:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945734400 00000100:00100000:1.0:1787388124.345264:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945734272 00000100:00100000:1.0:1787388124.345267:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945734272 00000100:00100000:1.0:1787388124.345284:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787388124.345292:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1874211945734528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787388124.349147:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787388124.349171:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1874211945734400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787388124.349209:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1787388124.349236:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.349256:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a783a0f1/0x26817551a447523b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80a3 expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.349266:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787388124.349270:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388124.349275:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.349331:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a783a0f1/0x26817551a447523b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80a3 expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787388124.349692:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787388124.349773:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00080000:1.0:1787388124.350090:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388124.350096:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787388124.350198:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787388124.350203:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787388124 00002000:00010000:1.0:1787388124.350205:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787388124.350207:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787388124 -> 1787388124 00002000:00010000:1.0:1787388124.350217:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787388124.350299:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1874211945734528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5005us (5518us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787388124.350308:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787388124.350334:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787388124.350374:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3651:x1874211945734272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787388124.350392:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1787388124.350415:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8960db, atime: 0x6a8960dc, ctime: 0x6a8960db, blocks: 0x8 00010000:00010000:1.0:1787388124.350422:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a447548e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.350433:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787388124.350436:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388124.350441:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a447548e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.350454:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a447548e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.350463:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a447548e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.350471:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a447548e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.350487:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787388124.350610:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3651:x1874211945734272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 268us (5440us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787388124.350623:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00080000:1.0:1787388124.350674:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996b7f571880/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787388124.350681:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945734272:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787388124.350752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.350771:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925761280 00000100:00100000:1.0:1787388124.350776:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925761280 00010000:00010000:2.0:1787388124.351106:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a783a0f1/0x26817551a447523b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80a3 expref: 12 pid: 8490 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.351126:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874211945734656:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388124.351518:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388124.351729:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:1.0:1787388124.351738:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+13:2399:x1874211925761280:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787388124.352470:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388124.352480:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a447548e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.352491:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388124.352504:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a447548e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.352514:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a447548e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.352533:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a447548e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.352540:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da034b58/0x26817551a447548e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.352562:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388124.352564:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388124.352565:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787388124.352603:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996b7f573100/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787388124.352609:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945734528:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1787388124.357195:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1787388124.357217:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1787388124.357419:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874211945734656:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388124.357445:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388124.357728:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.357992:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925761408 00000100:00100000:2.0:1787388124.357999:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925761408 00010000:00010000:2.0:1787388124.358032:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a783a0f1/0x26817551a447523b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80a3 expref: 14 pid: 8490 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.358069:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 101 00000100:00100000:2.0:1787388124.358078:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+14:2401:x1874211925761408:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388124.358092:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388124.358097:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a783a0f1/0x26817551a447523b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80a3 expref: 14 pid: 8490 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.358111:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a783a0f1/0x26817551a447523b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80a3 expref: 14 pid: 8490 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.358152:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a783a0f1/0x26817551a447523b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80a3 expref: 14 pid: 8490 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.358169:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388124.358174:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787388124.358180:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.358190:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.358214:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388124.358235:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.358246:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.358257:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.358264:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+13:2401:x1874211925761408:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 186us (536us total) trans 0 rc 0/0 00010000:00010000:1.0:1787388124.358271:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.358279:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 101 00010000:00010000:1.0:1787388124.358294:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787388124.358489:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3650:x1874211945734400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9328us (13375us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787388124.358498:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1787388124.358520:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388124.358532:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.358540:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5dc00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388124.358544:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.358553:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.358566:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.358585:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd738315/0x26817551a4475487 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.358600:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388124.358602:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388124.358604:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787388124.358874:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996b7f573800/2, rc 0, transno 4294967323 00000100:00100000:0.0:1787388124.358881:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945734400:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787388124.360609:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1787388124.360623:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1787388124.361104:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+7:2399:x1874211925761280:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 9362us (10347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.361115:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:1.0:1787388124.366075:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.366385:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925761664 00000100:00100000:3.0:1787388124.366395:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925761664 00000100:00100000:3.0:1787388124.366461:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 245 00000100:00100000:3.0:1787388124.366472:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+21:12486:x1874211925761664:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787388124.366532:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388124.366587:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5de00/0x26817551a4475472 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe813d expref: 21 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.366606:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:3.0:1787388124.366611:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388124.366644:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.366658:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.366668:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787388124.366821:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000916c1b14 reply state 00000000bebdfaa1 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.366833:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.366840:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:3.0:1787388124.366842:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388124.366845:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388124.366944:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+22:12486:x1874211925761664:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 474us (877us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1787388124.366952:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 245 00000100:00100000:0.0:1787388124.372376:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.372502:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925761792 00000100:00100000:2.0:1787388124.372513:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925761792 00000100:00100000:2.0:1787388124.372574:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:2.0:1787388124.372585:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925761792:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787388124.372736:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787388124.372740:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787388124 -> 1787388124 00002000:00010000:2.0:1787388124.372743:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787388124 00002000:00010000:2.0:1787388124.372745:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787388124 -> 1787388124 00002000:00010000:2.0:1787388124.372747:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787388124.372961:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925761792:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 376us (621us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787388124.372982:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:2.0:1787388124.378691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.378754:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925762048 00000100:00100000:3.0:1787388124.378766:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925762048 00000100:00100000:3.0:1787388124.378846:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 246 00000100:00100000:3.0:1787388124.378857:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+22:12486:x1874211925762048:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787388124.378944:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.378961:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe812f expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.379313:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.379463:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe812f expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.379479:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe812f expref: 22 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388124.379496:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945734784:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388124.379594:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7bde93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388124.383476:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874211945734784:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388124.383507:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.384821:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.385007:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925762176 00000100:00100000:1.0:1787388124.385016:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925762176 00010000:00010000:1.0:1787388124.385055:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe812f expref: 23 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388124.385115:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 102 00000100:00100000:1.0:1787388124.385126:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+23:2401:x1874211925762176:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388124.385142:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388124.385149:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe812f expref: 23 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.385162:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe812f expref: 23 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.385186:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5cc00/0x26817551a4475456 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe812f expref: 23 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.385201:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:1.0:1787388124.385206:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.385215:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.385222:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.385252:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388124.385308:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388124.385308:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00e97fed-41ea-4716-be07-f037d23906cf+22:2401:x1874211925762176:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 183us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.385324:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 102 00010000:00010000:3.0:1787388124.385325:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.390063:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.390095:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.390105:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.390111:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388124.390116:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.390123:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.390140:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:1.0:1787388124.390143:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787388124.390148:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.390154:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a447549c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388124.390265:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+21:12486:x1874211925762048:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 Request processed in 11405us (11579us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787388124.390276:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 246 00000100:00100000:2.0:1787388124.395700:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.395765:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925762304 00000100:00100000:1.0:1787388124.395774:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925762304 00000100:00100000:1.0:1787388124.395847:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:1.0:1787388124.395857:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2399:x1874211925762304:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787388124.395903:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.395934:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.395942:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388124.395947:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388124.395950:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.395986:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388124.395999:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 8 pid: 8490 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388124.396014:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874211945734912:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388124.396099:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42260f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388124.397230:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945735296:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.397296:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388124.397319:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945735808:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.397371:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388124.397387:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945736320:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.397409:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388124.397434:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787388124.397441:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945735424:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.397463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388124.397479:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945735936:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.397496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388124.397511:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388124.397517:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945736448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388124.397540:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388124.397567:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945736448 00000100:00100000:2.0:1787388124.397678:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945735808 00000100:00100000:2.0:1787388124.397686:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945735808 00000100:00100000:0.0:1787388124.397720:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945735168:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.397742:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945735424 00000100:00100000:2.0:1787388124.397747:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945735424 00000100:00100000:0.0:1787388124.397754:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.397775:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945735168 00000100:00100000:2.0:1787388124.397788:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945735168 00000100:00100000:0.0:1787388124.397790:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945735680:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.397820:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787388124.397826:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.397833:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945735808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.397853:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945736192:0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.397887:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.397903:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945735808:12345-0@lo:400:kworker.0 Request processed in 72us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.397907:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787388124.397912:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787388124.397916:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945735040:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.397932:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945735680 00000100:00100000:2.0:1787388124.397937:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945735680 00000100:00100000:0.0:1787388124.397947:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.397957:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945736192 00000100:00100000:2.0:1787388124.397961:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945736192 00000100:00100000:0.0:1787388124.397979:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945735552:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.397984:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787388124.397992:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945735424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.398006:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388124.398029:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945736064:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.398033:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945735424:12345-0@lo:400:kworker.0 Request processed in 40us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.398041:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787388124.398056:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787388124.398061:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.398068:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945735168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.398076:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945736576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388124.398108:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945735168:12345-0@lo:400:kworker.0 Request processed in 42us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.398109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.398124:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787388124.398138:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945736064 00000100:00100000:2.0:1787388124.398141:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945736064 00000100:00100000:0.0:1787388124.398149:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945735168:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.398161:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787388124.398170:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945735680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.398184:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945735040 00000100:00100000:0.0:1787388124.398189:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945735040 00000100:00100000:2.0:1787388124.398208:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945735680:12345-0@lo:400:kworker.0 Request processed in 39us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.398215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787388124.398226:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787388124.398233:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787388124.398237:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945735040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.398246:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945736192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.398276:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945735040:12345-0@lo:400:kworker.0 Request processed in 43us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.398286:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945736192:12345-0@lo:400:kworker.0 Request processed in 43us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.398287:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787388124.398298:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787388124.398314:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787388124.398323:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945736064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.398324:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945736576 00000100:00100000:0.0:1787388124.398330:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945736576 00000100:00100000:2.0:1787388124.398398:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945736064:12345-0@lo:400:kworker.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.398405:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787388124.398406:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787388124.398417:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945736576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388124.398434:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:0.0:1787388124.398923:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945736576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 508us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.398938:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787388124.398967:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945735296 00000100:00100000:0.0:1787388124.398971:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945735296 00000100:00100000:0.0:1787388124.399003:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945735552 00000100:00100000:0.0:1787388124.399006:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945735552 00000100:00100000:0.0:1787388124.399021:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787388124.399027:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945735296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.399064:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945735296:12345-0@lo:400:kworker.0 Request processed in 37us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.399071:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787388124.399082:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787388124.399087:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945735552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.399113:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945735552:12345-0@lo:400:kworker.0 Request processed in 25us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.399118:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787388124.399144:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945735040:0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.399154:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945735552:0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.399163:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945736064:0@lo:400:kworker.0 00000100:00100000:0.0:1787388124.399177:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945736576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388124.399187:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945735680:0@lo:400:kworker.0 00010000:00080000:0.0:1787388124.399199:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43805f80 x1874211945736192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388124.399210:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945736192:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.399538:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945736448 00000100:00080000:1.0:1787388124.399697:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388124.399703:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388124.399705:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388124.399720:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945736320 00000100:00100000:1.0:1787388124.399724:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945736320 00000100:00100000:1.0:1787388124.399751:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945735936 00000100:00100000:1.0:1787388124.399754:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945735936 00000100:00080000:1.0:1787388124.399769:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388124.399838:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787388124.399849:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945736448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388124.399864:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:1.0:1787388124.399866:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787388124.399877:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945736320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.399906:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945736448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388124.399913:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787388124.399933:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945736320:12345-0@lo:400:kworker.0 Request processed in 58us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.399941:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787388124.399954:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000100:00100000:1.0:1787388124.399959:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000004:00080000:3.0:1787388124.399962:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000100:00100000:1.0:1787388124.399981:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945735936:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1787388124.399990:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996b52ef0700, transno 4294967308 00000004:00080000:3.0:1787388124.400010:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000100:00100000:1.0:1787388124.400020:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945735936:12345-0@lo:400:kworker.0 Request processed in 53us (2521us total) trans 0 rc 0/0 00000004:00080000:3.0:1787388124.400025:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996b7f571880, transno 4294967311 00000100:00100000:1.0:1787388124.400027:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787388124.400046:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945736448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388124.400063:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945735424:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.400073:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945735936:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.400083:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945735296:0@lo:400:kworker.0 00010000:00080000:3.0:1787388124.400094:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43804380 x1874211945735808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388124.400103:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945735808:0@lo:400:kworker.0 00000100:00100000:3.0:1787388124.400115:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945736320:0@lo:400:kworker.0 00000100:00100000:2.0:1787388124.403969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.404513:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874211945734912:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388124.404547:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388124.404847:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925762432 00000100:00100000:0.0:1787388124.404854:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925762432 00010000:00010000:0.0:1787388124.404889:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 9 pid: 8490 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388124.404926:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 103 00000100:00100000:0.0:1787388124.404934:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+9:2401:x1874211925762432:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388124.404948:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388124.404972:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 9 pid: 8490 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.404985:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 9 pid: 8490 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.405009:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc24377/0x26817551a4475480 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe814b expref: 9 pid: 8490 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.405024:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388124.405028:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787388124.405033:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.405043:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.405322:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388124.405440:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925762432:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 505us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.405448:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 103 00010000:00010000:2.0:1787388124.407850:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.407870:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.407924:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.407933:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.407941:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.407948:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f200 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388124.407953:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.407961:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.407981:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.407988:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a44754a3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.408125:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:2399:x1874211925762304:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 12264us (12428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.408135:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:2.0:1787388124.423513:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.423558:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.423725:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925762688 00000100:00100000:1.0:1787388124.423735:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925762688 00000100:00100000:1.0:1787388124.423818:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925763328 00000100:00100000:1.0:1787388124.423822:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925763328 00000100:00100000:1.0:1787388124.423849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 354 00000100:00100000:1.0:1787388124.423860:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925762688:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388124.423864:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 247 00000100:00100000:3.0:1787388124.423878:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+21:12486:x1874211925763328:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787388124.423937:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925762688:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 78us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.423945:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 354 00010000:00010000:3.0:1787388124.423947:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.423976:0:13515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f7 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.423986:0:13515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.424022:0:13515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f7 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.424037:0:13515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f7 expref: 21 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388124.424073:0:13515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945736704:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388124.424126:0:13515:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7bde93c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787388124.424311:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388124.426697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.426966:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925762944 00000100:00100000:3.0:1787388124.426986:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925762944 00000100:00100000:3.0:1787388124.427058:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 355 00000100:00100000:3.0:1787388124.427068:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925762944:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388124.427145:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925762944:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 78us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388124.427153:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 355 00000100:00080000:0.0:1787388124.428185:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388124.430329:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.430425:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.430448:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.430560:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925763072 00000100:00100000:2.0:1787388124.430575:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925763072 00000100:00100000:1.0:1787388124.430611:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925762816 00000100:00100000:1.0:1787388124.430617:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925762816 00000100:00100000:2.0:1787388124.430651:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 356 00000100:00100000:1.0:1787388124.430664:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:1.0:1787388124.430675:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925762816:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388124.430683:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925763072:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388124.430757:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925763072:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00080000:3.0:1787388124.430760:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388124.430769:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 356 00000100:00100000:0.0:1787388124.430833:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925762560 00000100:00100000:0.0:1787388124.430837:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925762560 00000100:00100000:0.0:1787388124.430877:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 397 00000100:00100000:0.0:1787388124.430885:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925762560:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388124.440082:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925762816:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 9397us (9644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.440097:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:0.0:1787388124.440485:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925762560:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 9597us (10160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.440496:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 397 00000100:00100000:3.0:1787388124.441675:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.441681:0:13515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945736704:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388124.441709:0:13515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388124.441866:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925763456 00000100:00100000:0.0:1787388124.441873:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925763456 00010000:00010000:0.0:1787388124.441905:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f7 expref: 22 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388124.441940:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 104 00000100:00100000:0.0:1787388124.441948:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+22:2402:x1874211925763456:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388124.441962:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388124.441969:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f7 expref: 22 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.441982:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f7 expref: 22 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.442022:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e000/0x26817551a4475399 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe80f7 expref: 22 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.442036:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:0.0:1787388124.442041:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe811a expref: 21 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.442049:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.442055:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.442061:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.442090:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388124.442136:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+21:2402:x1874211925763456:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 188us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.442143:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 104 00010000:00010000:2.0:1787388124.443190:0:13515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.443202:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.443438:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.443454:0:13515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4475464 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8136 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.443461:0:13515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.443500:0:13515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4475464 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8136 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.443514:0:13515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4475464 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8136 expref: 21 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.443530:0:13515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945736832:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388124.443607:0:13515:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787388124.452713:0:13515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945736832:192.168.203.15@tcp:104: 00010000:00010000:2.0:1787388124.452742:0:13515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388124.454751:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388124.455082:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925763584 00000100:00100000:2.0:1787388124.455092:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925763584 00010000:00010000:2.0:1787388124.455134:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4475464 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8136 expref: 22 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.455177:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 105 00000100:00100000:2.0:1787388124.455186:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+22:2402:x1874211925763584:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388124.455201:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388124.455207:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4475464 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8136 expref: 22 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.455219:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4475464 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8136 expref: 22 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.455259:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7200/0x26817551a4475464 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8136 expref: 22 pid: 6520 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.455273:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:2.0:1787388124.455278:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.455286:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.455293:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.455324:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388124.455383:0:13515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.455391:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.455417:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+21:2402:x1874211925763584:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 232us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.455425:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 105 00000001:00080000:3.0:1787388124.455497:0:13515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1787388124.455613:0:13515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1787388124.455650:0:13515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1787388124.455726:0:13515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13515:1874211945736960:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787388124.455771:0:13515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388124.455820:0:13515:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b45304300 going to sleep for 11 seconds 00000100:00100000:0.0:1787388124.455861:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945736960 00000100:00100000:0.0:1787388124.455866:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945736960 00000100:00100000:0.0:1787388124.455904:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787388124.455912:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13515:x1874211945736960:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787388124.456062:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13515:x1874211945736960:12345-0@lo:1000:mdt00_004.0 Request processed in 152us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.456069:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787388124.456158:0:13515:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787388124.456164:0:13515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1787388124.456198:0:13515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996b7f573100, transno 4294967322 00000100:00100000:3.0:1787388124.456221:0:13515:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff996b7f573800 x1874211945734400/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787388140 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388124.456234:0:13515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13515:1874211945736960:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787388124.463490:0:13515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1787388124.463598:0:13515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13515:1874211945737088:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787388124.463663:0:13515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388124.464038:0:13515:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787388124.464506:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945737088 00000100:00100000:0.0:1787388124.464514:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945737088 00000100:00100000:0.0:1787388124.464629:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787388124.464639:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13515:x1874211945737088:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787388124.465208:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13515:x1874211945737088:12345-0@lo:1000:mdt00_004.0 Request processed in 569us (1544us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787388124.465216:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787388124.475493:0:13515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13515:1874211945737088:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1787388124.475554:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475810:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475838:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475844:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.475848:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475856:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475871:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:2.0:1787388124.475874:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787388124.475878:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475884:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d000/0x26817551a44754b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475908:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475915:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475920:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475924:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fc00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.475927:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475941:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.475948:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:2.0:1787388124.475950:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787388124.475956:0:13515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe811a expref: 24 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.476040:0:13515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe811a expref: 24 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.476050:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe811a expref: 24 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.476090:0:13515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe811a expref: 24 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.476103:0:13515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945737216:192.168.203.15@tcp:105: 00000100:00100000:2.0:1787388124.476189:0:13515:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787388124.479062:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388124.479269:0:13515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13515:1874211945737216:192.168.203.15@tcp:105: 00010000:00010000:0.0:1787388124.479296:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479306:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a44753f4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479334:0:13515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754b8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479381:0:13515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479395:0:13515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479406:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479412:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754b8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479419:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479439:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030c00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388124.479443:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479450:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754b8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388124.479451:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925763712 00000100:00100000:1.0:1787388124.479458:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925763712 00010000:00010000:0.0:1787388124.479461:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:0.0:1787388124.479464:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787388124.479467:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754b8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479472:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754b8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479482:0:13515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479487:0:13515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479492:0:13515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388124.479507:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00010000:00010000:0.0:1787388124.479513:0:13515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6800 already unused, calling callback (ffffffffc18ee4f0) 00000100:00100000:1.0:1787388124.479516:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+25:12485:x1874211925763712:12345-192.168.203.15@tcp:49:lfs.0 00010000:00010000:0.0:1787388124.479516:0:13515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479522:0:13515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479542:0:13515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:0.0:1787388124.479544:0:13515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388124.479546:0:13515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.479551:0:13515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a44754aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388124.479692:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+25:12486:x1874211925763328:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 55817us (56131us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787388124.479701:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 247 00000020:00080000:0.0:1787388124.479706:0:13515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787388124.480476:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388124.480483:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388124.481114:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787388124.481126:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787388124.481905:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+24:12485:x1874211925763712:12345-192.168.203.15@tcp:49:lfs.0 Request processed in 2383us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388124.481917:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:0.0:1787388124.488057:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.488229:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925763968 00000100:00100000:3.0:1787388124.488240:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925763968 00000100:00100000:3.0:1787388124.488297:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:3.0:1787388124.488308:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dcca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+24:12486:x1874211925763968:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787388124.488597:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787388124.488629:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1787388124.488663:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.488678:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.488690:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.488698:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.488704:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.488725:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.488743:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787388124.489420:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dcca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+26:12486:x1874211925763968:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 1109us (1368us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787388124.489431:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00000020:00080000:3.0:1787388124.489436:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787388124.489488:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388124.489509:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.489518:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388124.489522:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.489531:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.489547:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:3.0:1787388124.489551:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787388124.489555:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.489562:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754bf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388124.489574:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388124.489576:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388124.489578:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388124.500339:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388124.500449:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925764224 00000100:00100000:3.0:1787388124.500459:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925764224 00000100:00100000:3.0:1787388124.500524:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 248 00000100:00100000:3.0:1787388124.500533:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+26:12485:x1874211925764224:12345-192.168.203.15@tcp:58:lfs.0 00000040:00080000:3.0:1787388124.500692:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787388124.500772:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+26:12485:x1874211925764224:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 238us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388124.500780:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 248 00000100:00100000:2.0:1787388124.534893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388124.535052:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925764352 00000100:00100000:0.0:1787388124.535062:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925764352 00000100:00100000:0.0:1787388124.535122:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 249 00000100:00100000:0.0:1787388124.535133:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+26:12488:x1874211925764352:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1787388124.535155:0:10197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388124.535525:0:10197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8152 expref: -99 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535601:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535616:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535627:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535655:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535663:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535670:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535739:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535750:0:10197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8113 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535758:0:10197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535804:0:10197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8113 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.535817:0:10197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8113 expref: 27 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388124.535832:0:10197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945737344:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388124.535932:0:10197:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a4235a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787388124.538139:0:10197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10197:1874211945737344:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388124.538172:0:10197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388124.538703:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388124.538759:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925764608 00000100:00100000:1.0:1787388124.538766:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925764608 00000100:00100000:1.0:1787388124.538836:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:1.0:1787388124.538846:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+28:6169:x1874211925764608:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787388124.539053:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+29:6169:x1874211925764608:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 208us (349us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787388124.539061:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:2.0:1787388124.540925:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388124.541129:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925764736 00000100:00100000:0.0:1787388124.541137:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925764736 00010000:00010000:0.0:1787388124.541599:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8113 expref: 29 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388124.541629:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 106 00000100:00100000:0.0:1787388124.541640:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+29:2401:x1874211925764736:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388124.541652:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388124.541658:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8113 expref: 29 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.541671:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8113 expref: 29 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.541692:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4f600/0x26817551a44753e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8113 expref: 29 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.541708:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:0.0:1787388124.541712:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.541722:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.541729:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388124.541816:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388124.541886:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00e97fed-41ea-4716-be07-f037d23906cf+28:2401:x1874211925764736:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 248us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388124.541894:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 106 00010000:00010000:2.0:1787388124.544558:0:10197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.544635:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388124.544704:0:10197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787388124.544709:0:10197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388124.544865:0:10197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.544880:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.544890:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.544896:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.544902:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.544908:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.544913:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.544920:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.544934:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:2.0:1787388124.544937:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.544940:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.544947:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.545040:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.545048:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.545054:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.545060:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388124.545063:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.545070:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.545079:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff996b74d0b500) 00010000:00010000:2.0:1787388124.545082:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388124.545085:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.545092:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.545133:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030c00/0x26817551a44754c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8152 expref: 28 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.545146:0:10197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8152 expref: 27 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388124.545176:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:2.0:1787388124.545178:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388124.545180:0:10197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031a00, rc 0) 00000100:00100000:2.0:1787388124.545293:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+27:12488:x1874211925764352:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 10161us (10408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388124.545303:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 249 00010000:00010000:0.0:1787388124.782610:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388125.423917:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945737472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388125.423984:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388125.424058:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945737472 00000100:00100000:2.0:1787388125.424066:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945737472 00000100:00100000:2.0:1787388125.424113:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787388125.424121:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945737472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388125.424154:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388125.424196:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945737472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388125.424204:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787388125.424254:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945737472:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787388125.426020:0:14661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388125.426028:0:14661:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388125.426061:0:14661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787388125.426069:0:14661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787388125.484508:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787388125.484515:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388125.484536:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787388125.484542:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787388125.484670:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945737600:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787388125.484807:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06300 going to sleep for 11 seconds 00000100:00100000:1.0:1787388125.500854:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1874211945737600:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787388125.520130:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388125.522298:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925764864 00000100:00100000:1.0:1787388125.522313:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925764864 00000100:00100000:1.0:1787388125.522410:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00100000:1.0:1787388125.522421:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+27:12499:x1874211925764864:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787388125.522456:0:13515:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787388125.522591:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+27:12499:x1874211925764864:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 171us (2470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388125.522599:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00080000:2.0:1787388125.523282:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388125.529320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388125.529457:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925765120 00000100:00100000:0.0:1787388125.529467:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925765120 00000100:00100000:0.0:1787388125.529526:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 251 00000100:00100000:0.0:1787388125.529537:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+27:12499:x1874211925765120:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787388125.529556:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388125.529579:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8159 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.529683:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.529699:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.529712:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388125.529722:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787388125.529840:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8159 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.529855:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8159 expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.529863:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:0.0:1787388125.529871:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388125.529875:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030400, rc 0) 00000100:00100000:0.0:1787388125.529933:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+29:12499:x1874211925765120:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 398us (622us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787388125.529941:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 251 00000100:00100000:1.0:1787388125.548686:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388125.548793:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388125.548990:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925765376 00000100:00100000:0.0:1787388125.549002:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925765376 00000100:00100000:0.0:1787388125.549059:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 252 00000100:00100000:0.0:1787388125.549069:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+29:12499:x1874211925765376:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787388125.549315:0:10197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.549335:0:10197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.549365:0:10197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.549516:0:10197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.549524:0:10197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.549531:0:10197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.549537:0:10197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388125.549541:0:10197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.549565:0:10197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754f7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.549578:0:10197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:0.0:1787388125.549581:0:10197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388125.549586:0:10197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754f7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388125.549592:0:10197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030000/0x26817551a44754f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388125.549711:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+30:12499:x1874211925765376:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 642us (1035us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787388125.549719:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 252 00000040:00080000:1.0:1787388125.549932:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787388125.549937:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787388125.550539:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787388125.550551:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787388125.550747:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925765504 00000100:00100000:3.0:1787388125.550756:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925765504 00000100:00100000:3.0:1787388125.550828:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1787388125.550839:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+30:2401:x1874211925765504:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388125.550853:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388125.550872:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a44754e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8159 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388125.550888:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:3.0:1787388125.550893:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388125.550929:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00e97fed-41ea-4716-be07-f037d23906cf+29:2401:x1874211925765504:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 91us (2143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388125.550938:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:2.0:1787388125.571969:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388125.572540:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925765760 00000100:00100000:0.0:1787388125.572551:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925765760 00000100:00100000:0.0:1787388125.572841:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:0.0:1787388125.572854:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+29:12499:x1874211925765760:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787388125.573109:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+30:12499:x1874211925765760:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 259us (1149us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787388125.573212:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00010000:00010000:3.0:1787388125.804580:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388126.445199:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945737728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388126.445283:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388126.445570:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388126.445579:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945737856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388126.445608:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388126.445756:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945737728 00000100:00100000:3.0:1787388126.445774:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945737728 00000100:00100000:3.0:1787388126.445837:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945737856 00000100:00100000:3.0:1787388126.445841:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945737856 00000100:00100000:3.0:1787388126.445859:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787388126.445866:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1874211945737728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388126.445893:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787388126.445937:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1874211945737728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388126.445944:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787388126.445959:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787388126.445965:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945737856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388126.445974:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:0.0:1787388126.446139:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388126.446177:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945737856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388126.446189:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945737728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388126.446246:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945737856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 280us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388126.446252:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00010000:0.0:1787388126.829210:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388127.324784:0:14712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388127.324792:0:14712:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388127.324825:0:14712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787388127.324831:0:14712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787388127.511740:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388127.511832:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925766016 00000100:00100000:3.0:1787388127.511844:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925766016 00000100:00100000:3.0:1787388127.511923:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 253 00000100:00100000:3.0:1787388127.511934:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+30:12520:x1874211925766016:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388127.511969:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388127.512026:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8160 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388127.512138:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4475505 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388127.512163:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4475505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388127.512176:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4475505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388127.512189:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787388127.512288:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6400/0x26817551a44754fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8160 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388127.512305:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4475505 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8160 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388127.512314:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:3.0:1787388127.512317:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787388127.512320:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6200, rc 0) 00000100:00100000:3.0:1787388127.512397:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+32:12520:x1874211925766016:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 465us (666us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787388127.512405:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 253 00000100:00080000:2.0:1787388127.512826:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388127.519167:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388127.519217:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925766144 00000100:00100000:0.0:1787388127.519226:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925766144 00000100:00100000:0.0:1787388127.519279:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 254 00000100:00100000:0.0:1787388127.519287:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+32:12520:x1874211925766144:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:0.0:1787388127.519394:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475513 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.519411:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.519421:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.519454:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.519459:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475513 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.519464:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.519469:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:0.0:1787388127.519473:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.519480:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475513 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.519497:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:0.0:1787388127.519499:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787388127.519504:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475513 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.519510:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40030400/0x26817551a4475513 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388127.519588:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+32:12520:x1874211925766144:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 301us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388127.519597:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 254 00000100:00100000:3.0:1787388127.629273:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388127.629605:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925766272 00000100:00100000:2.0:1787388127.629614:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925766272 00000100:00100000:0.0:1787388127.629789:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00100000:0.0:1787388127.629799:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+7:2402:x1874211925766272:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:0.0:1787388127.629816:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388127.629837:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ebb02e9/0x26817551a447551a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8167 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388127.629864:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8960dc, atime: 0x6a8960dc, ctime: 0x6a8960dc, blocks: 0x8 00010000:00010000:0.0:1787388127.629886:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1787388127.629891:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388127.629901:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ebb02e9/0x26817551a447551a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8167 expref: 8 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.629918:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ebb02e9/0x26817551a447551a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8167 expref: 8 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388127.629958:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030400, rc 0) 00000100:00100000:0.0:1787388127.630020:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925766272:12345-192.168.203.15@tcp:101:cat.0 Request processed in 223us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388127.630027:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00080000:2.0:1787388127.630272:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388127.637539:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388127.637713:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925766400 00000100:00100000:1.0:1787388127.637723:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925766400 00002000:00100000:1.0:1787388127.637835:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff996a43b9f800 x1874211925766400/t0(0) o3->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:383/0 lens 488/0 e 0 to 0 dl 1787388138 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388127.637847:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a43b9f800 with x1874211925766400 ext(0->4095) 00002000:00010000:1.0:1787388127.637852:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996a43b9f800 00000100:00100000:1.0:1787388127.637918:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:1.0:1787388127.637928:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925766400:12345-192.168.203.15@tcp:3:cat.0 00000100:00100000:1.0:1787388127.638125:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00e97fed-41ea-4716-be07-f037d23906cf+8:2401:x1874211925766400:12345-192.168.203.15@tcp:3:cat.0 Request processed in 197us (594us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787388127.638133:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00002000:00100000:1.0:1787388127.638139:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff996a43b9f800 x1874211925766400/t0(0) o3->00e97fed-41ea-4716-be07-f037d23906cf@192.168.203.15@tcp:383/0 lens 488/4536 e 0 to 0 dl 1787388138 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787388127.638148:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996a43b9f800 with x1874211925766400 ext(0->4095) 00002000:00010000:1.0:1787388127.638151:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996a43b9f800 00010000:00010000:3.0:1787388127.852499:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787388128.366255:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787388128.494981:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388128.495001:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945737984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388128.495097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388128.495167:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945737984 00000100:00100000:3.0:1787388128.495173:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945737984 00000100:00100000:3.0:1787388128.495217:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787388128.495226:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945737984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787388128.495271:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787388128.495321:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945737984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388128.495328:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787388128.495372:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945737984:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787388128.620572:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388128.620581:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388128.620599:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787388128.620605:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787388128.876519:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388129.516693:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945738240:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.516725:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945738368:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.516783:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388129.516797:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388129.516845:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945738880:0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.516848:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945738752:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.516885:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388129.516890:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388129.516949:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945738496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388129.517017:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945738112:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.517081:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945739392:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.517110:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388129.517128:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945739904:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.517148:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388129.517170:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388129.517176:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c10a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945739776:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.517196:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388129.517235:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945738368 00000100:00100000:1.0:1787388129.517242:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945738368 00000100:00100000:1.0:1787388129.517286:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945738752 00000100:00100000:1.0:1787388129.517289:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945738752 00000100:00100000:1.0:1787388129.517305:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787388129.517313:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945738368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.517398:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945738368:12345-0@lo:400:kworker.0 Request processed in 84us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.517404:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787388129.517422:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787388129.517428:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945738752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.517454:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945738752:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.517459:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787388129.517491:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945738240 00000100:00100000:1.0:1787388129.517495:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945738240 00000100:00100000:1.0:1787388129.517518:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945738880 00000100:00100000:1.0:1787388129.517521:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945738880 00000100:00100000:1.0:1787388129.517545:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787388129.517551:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945738240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.517581:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945738240:12345-0@lo:400:kworker.0 Request processed in 30us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.517586:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787388129.517598:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787388129.517604:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945738880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.517901:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945738880:12345-0@lo:400:kworker.0 Request processed in 296us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.517908:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787388129.517946:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945738368:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.517957:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945738880:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.518011:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945739392 00000100:00100000:1.0:1787388129.518015:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945739392 00000100:00100000:1.0:1787388129.518041:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945739904 00000100:00100000:1.0:1787388129.518044:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945739904 00000100:00100000:1.0:1787388129.518056:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945739776 00000100:00100000:1.0:1787388129.518058:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945739776 00000100:00100000:1.0:1787388129.518071:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787388129.518077:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1874211945739392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.518114:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1874211945739392:12345-0@lo:400:kworker.0 Request processed in 36us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.518123:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787388129.518145:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787388129.518151:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945739904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.518178:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945739904:12345-0@lo:400:kworker.0 Request processed in 28us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.518183:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787388129.518193:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787388129.518199:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945739776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.518222:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945739776:12345-0@lo:400:kworker.0 Request processed in 23us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.518227:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787388129.518249:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945739776:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.518260:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945739392:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.518268:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945739904:0@lo:400:kworker.0 00000100:00080000:1.0:1787388129.518462:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388129.518467:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388129.518470:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388129.519927:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945738752:0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.519940:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945739264:0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.519996:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388129.520175:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945738240:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.520211:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945739264 00000100:00100000:1.0:1787388129.520218:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945739264 00000100:00100000:1.0:1787388129.520320:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787388129.520328:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945739264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.520457:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388129.520485:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945739008:0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.520509:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388129.520529:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945739520:0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.520549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388129.520581:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945738496 00000100:00100000:0.0:1787388129.520585:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945738496 00000100:00100000:0.0:1787388129.520617:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787388129.520632:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945738496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388129.520669:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388129.520708:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945738496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388129.520715:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787388129.520736:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945739008 00000100:00100000:0.0:1787388129.520739:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945739008 00000100:00100000:1.0:1787388129.520823:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945739264:12345-0@lo:400:kworker.0 Request processed in 496us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.520831:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787388129.520855:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945739520 00000100:00100000:1.0:1787388129.520859:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945739520 00000100:00080000:2.0:1787388129.521326:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388129.521331:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388129.521334:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388129.521401:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.521435:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945738624:0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.521453:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787388129.521462:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945739008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.521503:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945739008:12345-0@lo:400:kworker.0 Request processed in 43us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.521511:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388129.521516:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787388129.521533:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945738624 00000100:00100000:0.0:1787388129.521537:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945738624 00000100:00100000:0.0:1787388129.521560:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787388129.521571:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945738624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.521600:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945738624:12345-0@lo:400:kworker.0 Request processed in 34us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388129.521606:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787388129.521631:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945738624:0@lo:400:kworker.0 00000100:00100000:2.0:1787388129.521711:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945738112 00000100:00100000:2.0:1787388129.521716:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945738112 00000100:00100000:2.0:1787388129.521744:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1787388129.521752:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945738112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.521827:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1787388129.521830:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945739136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388129.521838:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945739520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388129.521870:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874211945739520:12345-0@lo:400:kworker.0 Request processed in 35us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388129.521875:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787388129.521937:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945738112:12345-0@lo:400:kworker.0 Request processed in 187us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388129.521943:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787388129.522013:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945739264:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.522071:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388129.522095:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945739648:0@lo:400:kworker.0 00000100:00100000:3.0:1787388129.522116:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388129.522247:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945738496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388129.522256:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945739136 00000100:00100000:3.0:1787388129.522258:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945739648 00000100:00100000:3.0:1787388129.522262:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945739648 00000100:00100000:1.0:1787388129.522265:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945739136 00010000:00080000:0.0:1787388129.522281:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f570a80 x1874211945739008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388129.522292:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945739008:0@lo:400:kworker.0 00000100:00100000:1.0:1787388129.522296:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787388129.522302:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945739136:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388129.522303:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945739520:0@lo:400:kworker.0 00002000:00000024:1.0:1787388129.522314:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787388129.522342:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945739136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.522371:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787388129.522394:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787388129.522403:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945739648:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787388129.522435:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388129.522440:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945739648:12345-0@lo:400:kworker.0 Request processed in 38us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.522448:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00010000:00080000:2.0:1787388129.522467:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c109f80 x1874211945739648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388129.522477:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945739648:0@lo:400:kworker.0 00000100:00100000:2.0:1787388129.522496:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945738112:0@lo:400:kworker.0 00000100:00100000:2.0:1787388129.522510:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945739136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388129.539644:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388129.539690:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388129.539729:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388129.539851:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925767040 00000100:00100000:3.0:1787388129.539862:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925767040 00000100:00100000:1.0:1787388129.539862:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388129.539892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388129.539915:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388129.539930:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925766912 00000100:00100000:3.0:1787388129.539935:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925766912 00000100:00100000:1.0:1787388129.539946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388129.539968:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:1.0:1787388129.539975:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925766784 00000100:00100000:1.0:1787388129.539980:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925766784 00000100:00100000:3.0:1787388129.539994:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925767040:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388129.540014:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925767296 00000100:00100000:1.0:1787388129.540018:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925767296 00000100:00100000:1.0:1787388129.540035:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925766656 00000100:00100000:1.0:1787388129.540038:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925766656 00000100:00100000:1.0:1787388129.540055:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925767168 00000100:00100000:1.0:1787388129.540058:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925767168 00000100:00100000:1.0:1787388129.540076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 363 00000100:00100000:3.0:1787388129.540084:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925767040:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 92us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.540086:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925766784:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388129.540099:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:3.0:1787388129.540118:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:3.0:1787388129.540129:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925766912:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388129.540129:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00e97fed-41ea-4716-be07-f037d23906cf+5:2402:x1874211925766784:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 43us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.540144:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 363 00000100:00100000:1.0:1787388129.540162:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 364 00000100:00100000:3.0:1787388129.540166:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00e97fed-41ea-4716-be07-f037d23906cf+8:2402:x1874211925766912:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 40us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.540176:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:3.0:1787388129.540198:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 365 00000100:00100000:3.0:1787388129.540206:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+32:2402:x1874211925766656:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388129.540230:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+32:2402:x1874211925766656:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.540235:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 365 00000100:00100000:3.0:1787388129.540248:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 366 00000100:00100000:3.0:1787388129.540253:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925767168:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388129.540272:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925767168:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 19us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388129.540278:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 366 00000100:00080000:3.0:1787388129.540418:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388129.540422:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388129.540425:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388129.540427:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388129.540520:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925766528 00000100:00100000:0.0:1787388129.540525:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925766528 00000100:00100000:0.0:1787388129.540567:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 399 00000100:00100000:0.0:1787388129.540578:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925766528:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388129.540626:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2402:x1874211925766528:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 51us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388129.540634:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 399 00000100:00100000:1.0:1787388129.540988:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925767296:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388129.541032:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2402:x1874211925767296:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 843us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388129.541040:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 364 00010000:00010000:3.0:1787388129.901902:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388130.544845:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945740032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388130.544948:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388130.547100:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945740032 00000100:00100000:3.0:1787388130.547118:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945740032 00000100:00100000:3.0:1787388130.547186:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787388130.547196:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945740032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787388130.547228:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787388130.547328:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945740032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388130.547336:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787388130.548493:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945740032:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1787388130.552178:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1787388130.552192:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1787388130.552260:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00010000:00010000:2.0:1787388130.552340:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.552369:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.552377:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.552382:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388130.552386:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.552393:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.552411:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff996b4900ca00) 00010000:00010000:2.0:1787388130.552414:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388130.552418:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388130.552423:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475495 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787388130.552481:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996b4300d900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787388130.552486:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b45051700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996b517f6e40 00000020:00080000:0.0:1787388130.552489:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff996b45051200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996a42faec00 00000020:00080000:0.0:1787388130.552519:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787388130.552536:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787388130.552606:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787388130.929331:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388131.564847:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388131.564879:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945740160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388131.564972:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388131.565057:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945740160 00000100:00100000:2.0:1787388131.565077:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945740160 00000100:00100000:2.0:1787388131.565321:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787388131.565344:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945740160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787388131.565427:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787388131.565518:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945740160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388131.565526:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1787388131.565556:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388131.565592:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1787388131.565599:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996b7f573800, transno 4294967323 00000004:00080000:2.0:1787388131.565611:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1787388131.565640:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945740160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388131.566046:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945740288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388131.566101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388131.568626:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945740288 00000100:00100000:2.0:1787388131.568643:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945740288 00000100:00080000:1.0:1787388131.568760:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388131.568988:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787388131.569004:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945740288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388131.569030:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787388131.569113:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945740288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388131.569122:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787388131.569197:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945740288:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787388131.950514:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388132.459337:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388132.459458:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925767424 00000100:00100000:0.0:1787388132.459472:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925767424 00000100:00100000:0.0:1787388132.459568:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 255 00000100:00080000:1.0:1787388132.459631:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388132.459671:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+18:12173:x1874211925767424:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787388132.459827:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00e97fed-41ea-4716-be07-f037d23906cf+18:12173:x1874211925767424:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 Request processed in 161us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388132.470855:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 255 00000100:00100000:3.0:1787388132.473475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388132.473624:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925767552 00000100:00100000:1.0:1787388132.473638:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925767552 00000100:00080000:3.0:1787388132.473702:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388132.473727:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 256 00000100:00100000:1.0:1787388132.473750:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:12173:x1874211925767552:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787388132.473897:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:12173:x1874211925767552:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 Request processed in 160us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388132.473906:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 256 00000100:00100000:3.0:1787388132.485371:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388132.488804:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925767808 00000100:00100000:0.0:1787388132.488823:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925767808 00000100:00100000:0.0:1787388132.488909:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:0.0:1787388132.488922:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:12173:x1874211925767808:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787388132.489371:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+19:12173:x1874211925767808:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 451us (4031us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787388132.489379:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:3.0:1787388132.725886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388132.726936:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925767936 00000100:00100000:1.0:1787388132.726958:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925767936 00000100:00080000:3.0:1787388132.727330:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388132.727514:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 257 00000100:00100000:1.0:1787388132.727529:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:12977:x1874211925767936:12345-192.168.203.15@tcp:101:lsof.0 00010000:00010000:1.0:1787388132.727558:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388132.727762:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe816e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.727839:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.727852:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.727881:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388132.727934:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388132.727938:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388132.727971:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.728001:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4ec00/0x26817551a4475521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe816e expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.728022:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe816e expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388132.728030:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d0be00) 00010000:00010000:1.0:1787388132.728033:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388132.728036:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fc00, rc 0) 00000100:00100000:1.0:1787388132.728114:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:12977:x1874211925767936:12345-192.168.203.15@tcp:101:lsof.0 Request processed in 588us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388132.728122:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 257 00010000:00010000:1.0:1787388132.972719:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388133.612838:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945740416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388133.612921:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388133.613029:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945740416 00000100:00100000:2.0:1787388133.613038:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945740416 00000100:00100000:2.0:1787388133.614923:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787388133.614936:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945740416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388133.614974:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787388133.621265:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945740416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6322us (8334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388133.621299:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787388133.621311:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945740416:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787388133.997323:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388134.636577:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388134.637499:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945740928:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.637569:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.637629:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388134.637636:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945740800:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.637667:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.637702:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945740928 00000100:00100000:0.0:1787388134.637710:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945740928 00000100:00100000:0.0:1787388134.637831:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787388134.637839:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945740928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.637888:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945740928:12345-0@lo:400:kworker.0 Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.637896:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787388134.637933:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945740928:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.637976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945740800 00000100:00100000:0.0:1787388134.637992:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945740800 00000100:00100000:0.0:1787388134.638019:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787388134.638026:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945740800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.638058:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3650:x1874211945740800:12345-0@lo:400:kworker.0 Request processed in 33us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.638065:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787388134.638088:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945741056:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.638111:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.638128:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388134.638134:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945740672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388134.638155:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.638181:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945740800:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.638207:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945740672 00000100:00100000:0.0:1787388134.638210:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945740672 00000100:00100000:0.0:1787388134.638241:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787388134.638247:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945740672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388134.638267:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388134.638299:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945740672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.638305:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787388134.638322:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945741056 00000100:00100000:0.0:1787388134.638325:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945741056 00000100:00100000:0.0:1787388134.638376:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787388134.638384:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945741056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.638415:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945741056:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.638431:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:0.0:1787388134.638450:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787388134.638471:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945740672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388134.638480:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945741056:0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.638882:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945740544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388134.638917:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.639847:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945740544 00000100:00100000:0.0:1787388134.639857:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945740544 00000100:00100000:0.0:1787388134.639919:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787388134.639927:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945740544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388134.639947:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388134.639996:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945740544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.640003:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1787388134.640449:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388134.640487:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945740544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388134.645143:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945741568:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.645205:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.645237:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945742080:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.645256:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.645274:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787388134.645279:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945741184:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.645298:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388134.645311:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945741696:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.645332:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.645390:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945741312:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.645423:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.645446:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945741824:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.645466:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.645483:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787388134.645489:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945741440:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.645509:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.645525:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945741952:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.645545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388134.645570:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945741568 00000100:00100000:0.0:1787388134.645577:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945741568 00000100:00100000:0.0:1787388134.645617:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945742080 00000100:00100000:0.0:1787388134.645620:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945742080 00000100:00100000:0.0:1787388134.645651:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945741184 00000100:00100000:0.0:1787388134.645654:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945741184 00000100:00100000:0.0:1787388134.645663:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945741440 00000100:00100000:0.0:1787388134.645665:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945741440 00000100:00100000:0.0:1787388134.645676:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945741952 00000100:00100000:0.0:1787388134.645678:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945741952 00000100:00100000:0.0:1787388134.645694:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787388134.645702:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945741568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787388134.645883:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388134.645889:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388134.645901:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787388134.645911:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945742080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.645962:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945742080:12345-0@lo:400:kworker.0 Request processed in 54us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.645970:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787388134.645990:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787388134.645996:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945741184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.646021:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945741184:12345-0@lo:400:kworker.0 Request processed in 25us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.646027:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787388134.646037:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787388134.646043:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945741440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.646070:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945741440:12345-0@lo:400:kworker.0 Request processed in 28us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.646076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787388134.646087:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787388134.646093:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945741952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.646118:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945741952:12345-0@lo:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.646124:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787388134.646270:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945741440:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.647061:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945741568:12345-0@lo:400:kworker.0 Request processed in 1356us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.647070:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787388134.647133:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945741312 00000100:00100000:0.0:1787388134.647139:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945741312 00000100:00100000:0.0:1787388134.647171:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787388134.647178:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945741312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.647212:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945741312:12345-0@lo:400:kworker.0 Request processed in 35us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.647219:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787388134.647254:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945741696 00000100:00100000:0.0:1787388134.647258:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945741696 00000100:00100000:0.0:1787388134.647300:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945741824 00000100:00100000:0.0:1787388134.647303:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945741824 00000100:00100000:0.0:1787388134.647321:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787388134.647327:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945741696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.647890:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945741952:0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.647903:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945741312:0@lo:400:kworker.0 00000100:00080000:1.0:1787388134.647938:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388134.648154:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787388134.648165:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945741824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388134.648232:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945741824:12345-0@lo:400:kworker.0 Request processed in 70us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388134.648239:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787388134.648274:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945741824:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.648647:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945741184:0@lo:400:kworker.0 00010000:00080000:3.0:1787388134.648664:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58dc00 x1874211945741568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388134.648685:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945741568:0@lo:400:kworker.0 00010000:00080000:3.0:1787388134.648698:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58d180 x1874211945742080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388134.648706:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945742080:0@lo:400:kworker.0 00000100:00100000:0.0:1787388134.649213:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945741696:12345-0@lo:400:kworker.0 Request processed in 1883us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.649220:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787388134.649298:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945741696:0@lo:400:kworker.0 00000100:00100000:3.0:1787388134.661985:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388134.662032:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388134.662072:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388134.662098:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388134.662117:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388134.662138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388134.662163:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388134.662190:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925768448 00000100:00100000:3.0:1787388134.662199:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925768448 00000100:00100000:3.0:1787388134.662255:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925768576 00000100:00100000:3.0:1787388134.662258:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925768576 00000100:00100000:3.0:1787388134.662281:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:3.0:1787388134.662290:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2399:x1874211925768448:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388134.662386:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+7:2399:x1874211925768448:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 96us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.662394:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:3.0:1787388134.662409:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:3.0:1787388134.662416:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925768576:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388134.662458:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925768576:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 42us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.662465:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00080000:3.0:1787388134.662493:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787388134.662497:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388134.662565:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925768192 00000100:00100000:3.0:1787388134.662569:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925768192 00000100:00100000:3.0:1787388134.662597:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925768704 00000100:00100000:3.0:1787388134.662600:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925768704 00000100:00100000:3.0:1787388134.662612:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925768320 00000100:00100000:3.0:1787388134.662614:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925768320 00000100:00100000:3.0:1787388134.662627:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925768832 00000100:00100000:3.0:1787388134.662630:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925768832 00000100:00100000:3.0:1787388134.662645:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 373 00000100:00100000:3.0:1787388134.662650:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+19:2399:x1874211925768192:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388134.662693:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+19:2399:x1874211925768192:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 42us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.662699:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 373 00000100:00100000:3.0:1787388134.662712:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 374 00000100:00100000:3.0:1787388134.662718:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2399:x1874211925768704:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388134.662756:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2399:x1874211925768704:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 38us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.662763:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 374 00000100:00100000:3.0:1787388134.662777:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 375 00000100:00100000:3.0:1787388134.662783:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925768320:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388134.662805:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2399:x1874211925768320:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.662818:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 375 00000100:00100000:3.0:1787388134.662830:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 376 00000100:00100000:3.0:1787388134.662836:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925768832:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388134.662862:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2399:x1874211925768832:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388134.662868:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 376 00000100:00080000:3.0:1787388134.662883:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388134.662886:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388134.663171:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925768064 00000100:00100000:0.0:1787388134.663177:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925768064 00000100:00100000:0.0:1787388134.663220:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 401 00000100:00100000:0.0:1787388134.663227:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925768064:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388134.663264:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2400:x1874211925768064:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 37us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388134.663271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 401 00010000:00010000:1.0:1787388135.020608:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388135.661998:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388135.662022:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945742208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388135.662089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388135.662403:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945742208 00000100:00100000:0.0:1787388135.662412:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945742208 00000100:00100000:0.0:1787388135.662514:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787388135.662524:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945742208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388135.662557:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787388135.662608:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945742208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388135.662614:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787388135.662793:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945742208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787388136.049096:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787388136.370787:0:14909:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:42:15 (1787388135) 00000100:00100000:1.0:1787388136.687898:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388136.687919:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945742336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388136.687994:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388136.688082:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945742336 00000100:00100000:0.0:1787388136.688090:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945742336 00000100:00100000:0.0:1787388136.688200:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787388136.688210:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945742336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388136.688238:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787388136.688284:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945742336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388136.688290:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787388136.688334:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945742336:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787388136.688676:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787388136.689074:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1787388136.689083:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787388136.689100:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787388136.689109:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1787388136.689324:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388136.689337:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945742464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388136.689454:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388136.689491:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945742464 00000100:00100000:3.0:1787388136.689497:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945742464 00000100:00100000:3.0:1787388136.689533:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787388136.689541:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945742464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388136.689568:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787388136.689603:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945742464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388136.689610:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1787388136.689626:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388136.689665:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945742464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787388137.069023:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388138.104328:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787388138.605021:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787388138.732783:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945742592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388138.732851:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388138.733158:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945742592 00000100:00100000:0.0:1787388138.733166:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945742592 00000100:00100000:0.0:1787388138.733217:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787388138.733240:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945742592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388138.733272:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787388138.733326:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945742592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388138.733332:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787388138.733399:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945742592:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787388138.860738:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787388138.860747:0:13802:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787388138.860847:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787388138.860854:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787388139.116645:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388139.756722:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945742848:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.756949:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945742976:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.756993:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388139.757043:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945743488:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388139.757093:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945744000:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388139.757159:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945743488 00000100:00100000:2.0:1787388139.757166:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945743488 00000100:00100000:2.0:1787388139.757211:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945744000 00000100:00100000:2.0:1787388139.757215:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945744000 00000100:00100000:2.0:1787388139.757235:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787388139.757242:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945743488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757290:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945743488:12345-0@lo:400:kworker.0 Request processed in 48us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388139.757297:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787388139.757312:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787388139.757317:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945744000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757341:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945744000:12345-0@lo:400:kworker.0 Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388139.757388:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:2.0:1787388139.757405:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388139.757416:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945742720:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388139.757465:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945743232:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757484:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388139.757498:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945743744:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757517:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388139.757536:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945744256:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757555:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388139.757573:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787388139.757579:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945743104:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388139.757612:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945743616:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757629:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388139.757643:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945744128:0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.757660:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388139.757684:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945743744 00000100:00100000:2.0:1787388139.757698:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945743744 00000100:00100000:2.0:1787388139.757723:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945744256 00000100:00100000:2.0:1787388139.757725:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945744256 00000100:00100000:2.0:1787388139.757735:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945743616 00000100:00100000:2.0:1787388139.757737:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945743616 00000100:00100000:2.0:1787388139.757746:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945744128 00000100:00100000:2.0:1787388139.757748:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945744128 00000100:00100000:2.0:1787388139.757758:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787388139.757945:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945743104 00000100:00100000:1.0:1787388139.757949:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945743104 00000100:00100000:1.0:1787388139.757972:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787388139.757977:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945743104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388139.758016:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945743104:12345-0@lo:400:kworker.0 Request processed in 39us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388139.758023:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787388139.758043:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787388139.758049:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945744256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388139.758079:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945744256:12345-0@lo:400:kworker.0 Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388139.758084:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787388139.758097:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787388139.758102:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945743616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388139.758122:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945743616:12345-0@lo:400:kworker.0 Request processed in 21us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388139.758127:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787388139.758135:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787388139.758139:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945744128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388139.758157:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945744128:12345-0@lo:400:kworker.0 Request processed in 17us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388139.758162:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1787388139.758172:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388139.758174:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787388139.758195:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a40a80 x1874211945743488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388139.758206:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945743488:0@lo:400:kworker.0 00010000:00080000:1.0:1787388139.758218:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a42d80 x1874211945744000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388139.758238:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945744000:0@lo:400:kworker.0 00000100:00100000:1.0:1787388139.758296:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945743104:0@lo:400:kworker.0 00000100:00100000:1.0:1787388139.758303:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945743616:0@lo:400:kworker.0 00000100:00100000:1.0:1787388139.758310:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945744128:0@lo:400:kworker.0 00000100:00100000:1.0:1787388139.758317:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945744256:0@lo:400:kworker.0 00000100:00100000:3.0:1787388139.758404:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388139.758423:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945743360:0@lo:400:kworker.0 00000100:00100000:3.0:1787388139.758445:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388139.758461:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945743872:0@lo:400:kworker.0 00000100:00100000:3.0:1787388139.758479:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388139.758505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945742848 00000100:00100000:3.0:1787388139.758508:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945742848 00000100:00100000:3.0:1787388139.758526:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945743360 00000100:00100000:3.0:1787388139.758529:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945743360 00000100:00100000:3.0:1787388139.758545:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945743872 00000100:00100000:3.0:1787388139.758547:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945743872 00000100:00100000:3.0:1787388139.758560:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787388139.758566:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945742848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388139.758599:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945742848:12345-0@lo:400:kworker.0 Request processed in 33us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388139.758605:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787388139.758616:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787388139.758622:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945743360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388139.758644:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945743360:12345-0@lo:400:kworker.0 Request processed in 23us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388139.758650:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787388139.758659:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787388139.758665:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945743872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388139.758698:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945743872:12345-0@lo:400:kworker.0 Request processed in 22us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388139.758711:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00080000:3.0:1787388139.758726:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388139.758745:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945742848:0@lo:400:kworker.0 00000100:00100000:3.0:1787388139.758754:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945743360:0@lo:400:kworker.0 00000100:00100000:3.0:1787388139.758762:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945743872:0@lo:400:kworker.0 00000100:00100000:0.0:1787388139.759015:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945742976 00000100:00100000:0.0:1787388139.759019:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945742976 00000100:00100000:0.0:1787388139.759047:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945743232 00000100:00100000:0.0:1787388139.759050:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945743232 00000100:00100000:0.0:1787388139.759066:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787388139.759072:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945742976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388139.759113:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945742976:12345-0@lo:400:kworker.0 Request processed in 42us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388139.759118:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787388139.759133:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787388139.759138:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945743232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388139.759172:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945743232:12345-0@lo:400:kworker.0 Request processed in 34us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388139.759177:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787388139.759200:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945742720 00000100:00100000:0.0:1787388139.759203:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945742720 00000100:00100000:0.0:1787388139.759224:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1787388139.759229:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945742720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388139.759258:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3652:x1874211945742720:12345-0@lo:400:kworker.0 Request processed in 29us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388139.759271:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1787388139.759316:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945742976:0@lo:400:kworker.0 00000100:00100000:0.0:1787388139.759328:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787388139.759334:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945744384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388139.759376:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388139.759402:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945744384 00000100:00100000:0.0:1787388139.759406:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945744384 00000100:00100000:0.0:1787388139.759430:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787388139.759436:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945744384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388139.759456:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388139.759487:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945744384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388139.759494:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787388139.759518:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945742720:0@lo:400:kworker.0 00000100:00100000:0.0:1787388139.759528:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945743232:0@lo:400:kworker.0 00000100:00100000:0.0:1787388139.759553:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945744384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388139.759594:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945744512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388139.759614:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388139.759640:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945744512 00000100:00100000:0.0:1787388139.759643:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945744512 00000100:00100000:0.0:1787388139.759661:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787388139.759667:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945744512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787388139.759676:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787388139.759718:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945744512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388139.759731:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787388139.759758:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945744512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388139.760052:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945743744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388139.760095:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945743744:12345-0@lo:400:kworker.0 Request processed in 2327us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388139.760102:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787388139.760130:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945743744:0@lo:400:kworker.0 00000100:00100000:3.0:1787388139.776818:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388139.776863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388139.776905:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388139.776935:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388139.776955:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388139.776971:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388139.776999:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388139.777024:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925769216 00000100:00100000:3.0:1787388139.777032:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925769216 00000100:00100000:3.0:1787388139.777078:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925769728 00000100:00100000:3.0:1787388139.777081:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925769728 00000100:00100000:3.0:1787388139.777093:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925769088 00000100:00100000:3.0:1787388139.777095:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925769088 00000100:00100000:3.0:1787388139.777106:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925769600 00000100:00100000:3.0:1787388139.777108:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925769600 00000100:00100000:3.0:1787388139.777122:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 383 00000100:00100000:3.0:1787388139.777130:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925769216:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388139.777213:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925769216:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 83us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388139.777220:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 383 00000100:00100000:3.0:1787388139.777236:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 384 00000100:00100000:3.0:1787388139.777258:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925769728:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388139.777284:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2401:x1874211925769728:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388139.777290:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 384 00000100:00100000:3.0:1787388139.777302:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 385 00000100:00100000:3.0:1787388139.777308:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+18:2401:x1874211925769088:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388139.777330:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+18:2401:x1874211925769088:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 22us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388139.777337:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 385 00000100:00100000:3.0:1787388139.777379:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 386 00000100:00100000:3.0:1787388139.777386:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2401:x1874211925769600:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388139.777409:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2401:x1874211925769600:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388139.777415:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 386 00000100:00080000:3.0:1787388139.777536:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388139.777540:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388139.778155:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925768960 00000100:00100000:0.0:1787388139.778176:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925768960 00000100:00100000:0.0:1787388139.778215:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 403 00000100:00100000:0.0:1787388139.778223:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925768960:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388139.778259:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26a556f-3215-464e-beb8-43d9848a19a5+13:2401:x1874211925768960:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 37us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388139.778265:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 403 00000100:00100000:1.0:1787388139.781021:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925769472 00000100:00100000:1.0:1787388139.781034:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925769472 00000100:00100000:1.0:1787388139.781111:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925769344 00000100:00100000:1.0:1787388139.781115:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925769344 00000100:00100000:1.0:1787388139.781140:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:1.0:1787388139.781148:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925769472:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388139.781230:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2401:x1874211925769472:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 81us (4323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388139.781238:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:1.0:1787388139.781255:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:1.0:1787388139.781263:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:2401:x1874211925769344:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388139.781287:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+7:2401:x1874211925769344:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (4316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388139.781294:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00080000:3.0:1787388139.783404:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388139.783416:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787388140.140968:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388140.211930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388140.212021:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925769984 00000100:00100000:0.0:1787388140.212031:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925769984 00000100:00100000:0.0:1787388140.212088:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:0.0:1787388140.212098:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+18:13200:x1874211925769984:12345-192.168.203.15@tcp:35:umount.0 00000100:00100000:0.0:1787388140.212409:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+19:13200:x1874211925769984:12345-192.168.203.15@tcp:35:umount.0 Request processed in 311us (486us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787388140.212417:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:1.0:1787388140.216179:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388140.216278:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925770240 00000100:00100000:0.0:1787388140.216287:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925770240 00000100:00100000:0.0:1787388140.216371:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:0.0:1787388140.216382:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+19:13200:x1874211925770240:12345-192.168.203.15@tcp:35:umount.0 00000100:00100000:0.0:1787388140.216660:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+20:13200:x1874211925770240:12345-192.168.203.15@tcp:35:umount.0 Request processed in 279us (489us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787388140.216668:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:1.0:1787388140.221105:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388140.221409:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925770496 00000100:00100000:0.0:1787388140.221433:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925770496 00000100:00100000:0.0:1787388140.221597:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:0.0:1787388140.221609:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dcc9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+20:13200:x1874211925770496:12345-192.168.203.15@tcp:35:umount.0 00000100:00100000:0.0:1787388140.221823:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dcc9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00e97fed-41ea-4716-be07-f037d23906cf+21:13200:x1874211925770496:12345-192.168.203.15@tcp:35:umount.0 Request processed in 216us (727us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787388140.221832:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:1.0:1787388140.225144:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388140.225310:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925770752 00000100:00100000:3.0:1787388140.225320:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925770752 00000100:00100000:3.0:1787388140.225471:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:3.0:1787388140.225482:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+21:13200:x1874211925770752:12345-192.168.203.15@tcp:35:umount.0 00000100:00100000:3.0:1787388140.225815:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00e97fed-41ea-4716-be07-f037d23906cf+22:13200:x1874211925770752:12345-192.168.203.15@tcp:35:umount.0 Request processed in 333us (678us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787388140.225834:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:1.0:1787388140.230927:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388140.231004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388140.231681:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388140.233091:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925770880 00000100:00100000:0.0:1787388140.233103:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925770880 00000100:00100000:0.0:1787388140.233295:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925771136 00000100:00100000:0.0:1787388140.233299:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925771136 00000100:00100000:3.0:1787388140.233433:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1787388140.233445:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26a556f-3215-464e-beb8-43d9848a19a5+14:2399:x1874211925770880:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388140.233461:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787388140.233643:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388140.233666:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925771008 00000100:00100000:1.0:1787388140.233669:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925771008 00000100:00100000:1.0:1787388140.233701:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:1.0:1787388140.233708:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+15:2399:x1874211925771136:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388140.233716:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388140.233733:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09000/0x26817551a4474752 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d9a expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.233750:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388140.233794:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+14:2399:x1874211925771136:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 87us (2790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.233801:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:1.0:1787388140.233815:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:1.0:1787388140.233821:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+13:2399:x1874211925771008:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388140.233828:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388140.233835:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e5e00/0x26817551a4474442 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7c82 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.233843:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388140.233864:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+12:2399:x1874211925771008:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 43us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.233870:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:1.0:1787388140.233888:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925771264 00000100:00100000:1.0:1787388140.233904:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925771264 00000100:00100000:1.0:1787388140.233930:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 81 00000100:00100000:1.0:1787388140.233936:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+5:2398:x1874211925771264:12345-192.168.203.15@tcp:9:umount.0 00000020:00000080:1.0:1787388140.233957:0:8434:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447481d 00000100:00080000:1.0:1787388140.233964:0:8434:0:(import.c:65:import_set_state_nolock()) ffff996a44052000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787388140.234004:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787388140.234129:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00e97fed-41ea-4716-be07-f037d23906cf+2:2398:x1874211925771264:12345-192.168.203.15@tcp:9:umount.0 Request processed in 192us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388140.234136:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 81 00010000:00010000:1.0:1787388140.234152:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388140.238843:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09800/0x26817551a44744ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cc1 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388140.238872:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388140.238945:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26a556f-3215-464e-beb8-43d9848a19a5+10:2399:x1874211925770880:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 5501us (8026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388140.238956:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1787388140.239038:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388140.239157:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925771648 00000100:00100000:3.0:1787388140.239274:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925771648 00000100:00100000:3.0:1787388140.239326:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 82 00000100:00100000:3.0:1787388140.239335:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+7:2398:x1874211925771648:12345-192.168.203.15@tcp:9:umount.0 00000020:00000080:3.0:1787388140.239390:0:8490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474a93 00000020:00010000:3.0:1787388140.239398:0:8490:0:(genops.c:1942:obd_stale_export_put()) Put export ffff996a43206800: total 0 00000100:00080000:3.0:1787388140.239402:0:8490:0:(import.c:65:import_set_state_nolock()) ffff996a43200800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787388140.239442:0:8490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787388140.239698:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00e97fed-41ea-4716-be07-f037d23906cf+5:2398:x1874211925771648:12345-192.168.203.15@tcp:9:umount.0 Request processed in 363us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388140.239705:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 82 00000020:00010000:3.0:1787388140.239723:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff996a43206800: total 0 00010000:00010000:3.0:1787388140.239744:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff996a43206800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787388140.239788:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ebb02e9/0x26817551a447551a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8167 expref: 4 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388140.239835:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1a24576/0x26817551a4474e4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f84 expref: 3 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388140.239851:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff996a43206800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787388140.239863:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388140.239865:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388140.239867:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388140.252194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388140.252605:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925772672 00000100:00100000:0.0:1787388140.252616:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925772672 00000100:00100000:0.0:1787388140.252677:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 258 00000100:00100000:0.0:1787388140.252849:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+22:2398:x1874211925772672:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:0.0:1787388140.252895:0:6522:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474450 00000020:00010000:0.0:1787388140.252910:0:6522:0:(genops.c:1942:obd_stale_export_put()) Put export ffff996a420ce800: total 0 00000100:00080000:0.0:1787388140.252914:0:6522:0:(import.c:65:import_set_state_nolock()) ffff996a420ca800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787388140.252943:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1787388140.253106:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00e97fed-41ea-4716-be07-f037d23906cf+21:2398:x1874211925772672:12345-192.168.203.15@tcp:39:umount.0 Request processed in 419us (919us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1787388140.253114:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 258 00000020:00010000:1.0:1787388140.253927:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff996a420ce800: total 0 00010000:00010000:1.0:1787388140.253934:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388140.253989:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff996a420ce800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787388140.254025:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d0be00) 00010000:00010000:1.0:1787388140.254030:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388140.254039:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031400/0x26817551a4474eb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fa0 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254061:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388140.254064:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787388140.254068:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6200/0x26817551a4475505 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8160 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254082:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:1.0:1787388140.254085:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787388140.254089:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a44747f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7dc4 expref: 18 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254126:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:1.0:1787388140.254129:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388140.254133:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a44751bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8080 expref: 17 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254147:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388140.254150:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787388140.254153:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e200/0x26817551a4474e36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f7d expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254176:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff996b43bd1300) 00010000:00010000:1.0:1787388140.254179:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787388140.254183:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e600/0x26817551a4474aee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7e9d expref: 15 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254202:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b728f7400) 00010000:00010000:1.0:1787388140.254204:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388140.254207:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fe00/0x26817551a4474798 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7daf expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254220:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388140.254222:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388140.254225:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f5d200/0x26817551a4474e0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f6f expref: 13 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254236:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388140.254238:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388140.254248:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4e400/0x26817551a44753fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe811a expref: 12 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254264:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff996b51436e00) 00010000:00010000:1.0:1787388140.254266:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787388140.254269:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7600/0x26817551a4474ed0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7fa7 expref: 11 pid: 13515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254284:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff996b74d0b000) 00010000:00010000:1.0:1787388140.254287:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388140.254290:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b40031a00/0x26817551a44754db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8152 expref: 10 pid: 10197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254304:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff996b73adff00) 00010000:00010000:1.0:1787388140.254307:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388140.254311:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6000/0x26817551a4474d2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7f37 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254325:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996b728f7300) 00010000:00010000:1.0:1787388140.254328:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388140.254332:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a447477c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7da8 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388140.254622:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff996a420ce800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787388140.254641:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388140.254642:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388140.254644:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388140.264695:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388140.264776:0:13515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925772800 00000100:00100000:3.0:1787388140.264786:0:13515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925772800 00000100:00100000:3.0:1787388140.264841:0:13515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 259 00000100:00100000:3.0:1787388140.264852:0:13515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+5:2398:x1874211925772800:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:3.0:1787388140.264893:0:13515:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474457 00000100:00080000:3.0:1787388140.264910:0:13515:0:(import.c:65:import_set_state_nolock()) ffff996a4310b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787388140.264940:0:13515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787388140.265113:0:13515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:00e97fed-41ea-4716-be07-f037d23906cf+3:2398:x1874211925772800:12345-192.168.203.15@tcp:39:umount.0 Request processed in 263us (435us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787388140.265121:0:13515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 259 00010000:00010000:2.0:1787388140.265900:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388140.780769:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388140.786835:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945744640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388140.786923:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388140.787091:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945744640 00000100:00100000:2.0:1787388140.787100:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945744640 00000100:00100000:2.0:1787388140.787147:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787388140.787155:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945744640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388140.787189:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787388140.787231:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945744640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388140.787238:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787388140.787606:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945744640:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787388141.165737:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388141.804632:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945744768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388141.804712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388141.805112:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945744768 00000100:00100000:3.0:1787388141.805120:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945744768 00000100:00100000:3.0:1787388141.805192:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787388141.805202:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945744768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388141.805230:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787388141.805277:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945744768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388141.805295:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1787388141.805699:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388141.805736:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945744768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388141.806064:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388141.806076:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945744896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787388141.806118:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388141.807723:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945744896 00000100:00100000:2.0:1787388141.807817:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945744896 00000100:00100000:2.0:1787388141.808022:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787388141.808032:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945744896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388141.808054:0:10098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787388141.808126:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945744896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388141.808133:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787388141.808190:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945744896:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787388141.808245:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787388142.188577:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388142.354187:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388142.354232:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388142.354315:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388142.354710:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925773056 00000100:00100000:2.0:1787388142.354721:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925773056 00000100:00100000:2.0:1787388142.354787:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925772928 00000100:00100000:2.0:1787388142.354810:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925772928 00000100:00100000:2.0:1787388142.354828:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925773184 00000100:00100000:2.0:1787388142.354831:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925773184 00000100:00100000:2.0:1787388142.354847:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:2.0:1787388142.354858:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+12:2402:x1874211925773056:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388142.354872:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388142.354892:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e08800/0x26817551a447455a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d07 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388142.354909:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388142.354965:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+11:2402:x1874211925773056:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 109us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388142.354986:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:2.0:1787388142.355007:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:2.0:1787388142.355013:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+10:2400:x1874211925772928:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388142.355021:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388142.355029:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b414a2400/0x26817551a4474553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cd6 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388142.355039:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388142.355059:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+9:2400:x1874211925772928:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 47us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388142.355272:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:2.0:1787388142.355317:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:2.0:1787388142.355323:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+8:2400:x1874211925773184:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388142.355341:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388142.355396:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a432f7c00/0x26817551a447474b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7d93 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388142.355413:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388142.355717:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26a556f-3215-464e-beb8-43d9848a19a5+7:2400:x1874211925773184:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 111us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388142.355725:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:3.0:1787388142.361319:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388142.361850:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925773440 00000100:00100000:1.0:1787388142.361861:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925773440 00000100:00100000:1.0:1787388142.361938:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 260 00000100:00100000:1.0:1787388142.361950:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+6:2398:x1874211925773440:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:1.0:1787388142.361999:0:6521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474568 00000020:00010000:1.0:1787388142.362008:0:6521:0:(genops.c:1942:obd_stale_export_put()) Put export ffff996a42fcc800: total 0 00000100:00080000:1.0:1787388142.362012:0:6521:0:(import.c:65:import_set_state_nolock()) ffff996a42fcd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787388142.362039:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1787388142.362475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2398:x1874211925773440:12345-192.168.203.15@tcp:39:umount.0 Request processed in 526us (1164us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1787388142.362482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 260 00000100:00080000:0.0:1787388142.362715:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1787388142.362892:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff996a42fcc800: total 0 00010000:00010000:2.0:1787388142.362940:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff996a42fcc800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787388142.363079:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b74d0be00) 00010000:00010000:2.0:1787388142.363083:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388142.363092:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b52f4fc00/0x26817551a4475528 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe816e expref: 4 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388142.363113:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff996a42fcc800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787388142.363126:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388142.363128:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388142.363130:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388142.371899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388142.371981:0:10197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925773568 00000100:00100000:3.0:1787388142.371989:0:10197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925773568 00000100:00100000:3.0:1787388142.372057:0:10197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 261 00000100:00100000:3.0:1787388142.372074:0:10197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+5:2398:x1874211925773568:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:3.0:1787388142.372110:0:10197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447456f 00000100:00080000:3.0:1787388142.372118:0:10197:0:(import.c:65:import_set_state_nolock()) ffff996a42fce800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787388142.372142:0:10197:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1787388142.372227:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388142.372580:0:10197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b62f6a8b-2ad2-4bdc-a970-3ca92e68d862+3:2398:x1874211925773568:12345-192.168.203.15@tcp:39:umount.0 Request processed in 513us (687us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787388142.372590:0:10197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 261 00000100:00080000:0.0:1787388142.372704:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388142.466479:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388142.466645:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925773824 00000100:00100000:0.0:1787388142.466655:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925773824 00000100:00100000:0.0:1787388142.466725:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 404 00000100:00100000:0.0:1787388142.466736:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+7:2398:x1874211925773824:12345-192.168.203.15@tcp:251:umount.0 00000020:00000080:0.0:1787388142.466781:0:6516:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447442d 00000020:00010000:0.0:1787388142.466789:0:6516:0:(genops.c:1942:obd_stale_export_put()) Put export ffff996a43399000: total 0 00000100:00080000:0.0:1787388142.466793:0:6516:0:(import.c:65:import_set_state_nolock()) ffff996a4339c000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787388142.466852:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff996a43399000: total 0 00010000:00010000:2.0:1787388142.466857:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388142.466871:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26a556f-3215-464e-beb8-43d9848a19a5+3:2398:x1874211925773824:12345-192.168.203.15@tcp:251:umount.0 Request processed in 136us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388142.466880:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 404 00010000:00010000:2.0:1787388142.466912:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff996a43399000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787388142.466954:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09600/0x26817551a4474506 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe7cc8 expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388142.472733:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff996a43399000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787388142.473019:0:6509:0:(genops.c:906:class_export_put()) final put ffff996a43399000/c26a556f-3215-464e-beb8-43d9848a19a5 00010000:00010000:3.0:1787388142.473075:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388142.473078:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388142.473080:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787388142.473195:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a43399000/c26a556f-3215-464e-beb8-43d9848a19a5 for MGS 00000020:00000080:1.0:1787388142.473310:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a4339c000 for MGS 00010000:00010000:1.0:1787388143.213260:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388143.853235:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388143.853260:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945745024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388143.853328:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388143.853454:0:12997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945745024 00000100:00100000:1.0:1787388143.853463:0:12997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945745024 00000100:00100000:1.0:1787388143.853515:0:12997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787388143.853524:0:12997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945745024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388143.853557:0:12997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787388143.853606:0:12997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945745024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388143.853614:0:12997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787388143.853677:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945745024:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388144.237383:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787388144.257487:0:15105:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787388144.269795:0:15105:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787388144.269887:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.269904:0:15105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.269911:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.269918:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.269938:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787388144.269943:0:15105:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787388144.269972:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388144.269978:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.269985:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077a00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787388144.269989:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.269999:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388144.270006:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388144.270023:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787388144.270025:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787388144.270028:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787388144.272193:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.272207:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388144.272247:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.272254:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70077a00/0x26817551a44744d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.272268:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388144.272270:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388144.272272:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388144.272290:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945745152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388144.272375:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.272413:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945745152 00000100:00100000:2.0:1787388144.272422:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945745152 00000100:00080000:1.0:1787388144.272458:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787388144.272463:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787388144.272469:0:15105:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787388144.272476:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787388144.272485:0:15105:0:(import.c:65:import_set_state_nolock()) ffff996b73970000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787388144.272487:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+24:3651:x1874211945745152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388144.272533:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388144.272549:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e5800/0x26817551a44744dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a44744d5 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.272562:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388144.272609:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3651:x1874211945745152:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388144.272617:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787388144.272649:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874211945745280:0@lo:39:umount.0 00000100:00100000:2.0:1787388144.272686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.272717:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945745280 00000100:00100000:2.0:1787388144.272720:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945745280 00000100:00100000:2.0:1787388144.272747:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787388144.272755:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874211945745280:12345-0@lo:39:umount.0 00000100:00100000:1.0:1787388144.272770:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945745152:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787388144.272780:0:6520:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474052 00000100:00080000:2.0:1787388144.272788:0:6520:0:(import.c:65:import_set_state_nolock()) ffff996b73a8f800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787388144.272810:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388144.272848:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3648:x1874211945745280:12345-0@lo:39:umount.0 Request processed in 94us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388144.272857:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:1.0:1787388144.272873:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b73970000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1787388144.272874:0:6520:0:(genops.c:906:class_export_put()) final put ffff996b73a88800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1787388144.272889:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874211945745280:0@lo:39:umount.0 00000020:00000080:2.0:1787388144.272905:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b73a88800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1787388144.272914:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787388144.272923:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787388144.272928:0:15105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787388144.272946:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b73a8f800 for lustre-MDT0000 00010000:00010000:1.0:1787388144.273977:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.273990:0:15105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.273998:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.274004:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.274024:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388144.274037:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388144.274042:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.274050:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09a00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787388144.274182:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.274191:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388144.274198:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388144.274203:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787388144.274206:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787388144.274314:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.274322:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787388144.274367:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.274375:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e09a00/0x26817551a44744e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.274390:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388144.274392:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388144.274394:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388144.274410:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945745408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388144.274464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388144.274528:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945745408 00000100:00100000:1.0:1787388144.274534:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945745408 00000100:00100000:1.0:1787388144.274570:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787388144.274579:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3652:x1874211945745408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388144.275709:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388144.275733:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70077800/0x26817551a44744ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a44744e3 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388144.275746:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388144.275807:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530741c0-7948-4b28-86b1-ece4c1322eb9+22:3652:x1874211945745408:12345-0@lo:103:ldlm_bl.0 Request processed in 1228us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388144.275815:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787388144.275840:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.275852:0:15105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388144.276067:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:530741c0-7948-4b28-86b1-ece4c1322eb9:3652:1874211945745408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388144.276223:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.276231:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.276254:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787388144.276262:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.276269:0:15105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.276274:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.276280:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.276296:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787388144.276301:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.276307:0:15105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.276313:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.276331:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388144.276339:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1787388144.276343:0:15105:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787388144.276367:0:15105:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787388144.276405:0:15105:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787388144.276409:0:15105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787388144.276413:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388144.276418:0:15105:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787388144.276423:0:15105:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff996a42fca000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787388144.276429:0:15105:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff996a41f5d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787388144.276433:0:15105:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff996b74c0a800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787388144.276438:0:15105:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff996b44968800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787388144.276445:0:15105:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff996a42fcc800 b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 192.168.203.15@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787388144.276451:0:15105:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff996a420ce800 00e97fed-41ea-4716-be07-f037d23906cf 192.168.203.15@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1787388144.276457:0:15105:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff996b450e19c0) has exports, disconnecting them 00000020:00080000:2.0:1787388144.276461:0:15105:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff996a42fca000), last request at 1787388139 00000020:00000080:2.0:1787388144.276467:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447435b 00000100:00080000:2.0:1787388144.276483:0:15105:0:(import.c:65:import_set_state_nolock()) ffff996a42fcd000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787388144.276654:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787388144.276669:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276677:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031c00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787388144.276686:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276694:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388144.276701:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388144.276707:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787388144.276710:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787388144.276712:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787388144.276737:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276743:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388144.276763:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276770:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b40031c00/0x26817551a44743e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44743ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276782:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787388144.276785:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276791:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08e00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787388144.276793:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276799:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388144.276811:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388144.276816:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787388144.276818:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787388144.276820:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787388144.276833:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276839:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388144.276845:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276851:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e08e00/0x26817551a447473d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4474744 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276872:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388144.276876:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276881:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077e00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787388144.276884:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276890:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388144.276896:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388144.276910:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787388144.276913:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787388144.276915:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787388144.276927:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276932:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388144.276946:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276952:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70077e00/0x26817551a4473fa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4473faa expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.276961:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388144.276963:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388144.276964:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388144.276977:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945745536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388144.277300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388144.277341:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388144.277371:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945745664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388144.277397:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388144.277426:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945745536 00000100:00100000:3.0:1787388144.277432:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945745536 00000100:00100000:3.0:1787388144.277468:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945745664 00000100:00100000:3.0:1787388144.277470:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945745664 00000100:00100000:3.0:1787388144.277491:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787388144.277498:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+23:3649:x1874211945745536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388144.277713:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388144.277735:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e4e00/0x26817551a44743ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a44743e7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.277746:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388144.277782:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+22:3649:x1874211945745536:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388144.277789:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787388144.277806:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787388144.277812:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+21:3649:x1874211945745664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388144.277819:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388144.277828:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09200/0x26817551a4474744 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a447473d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.277836:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388144.277857:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+20:3649:x1874211945745664:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388144.277874:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787388144.277908:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945745664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388144.277916:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945745536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388144.277936:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945745792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388144.277959:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388144.277982:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945745792 00000100:00100000:3.0:1787388144.277986:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945745792 00000100:00100000:3.0:1787388144.278008:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787388144.278013:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+20:3651:x1874211945745792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388144.278126:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388144.278142:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b413ff600/0x26817551a4473faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a4473fa3 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388144.278152:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388144.278180:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530741c0-7948-4b28-86b1-ece4c1322eb9+19:3651:x1874211945745792:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388144.278187:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787388144.278212:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945745792:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787388144.278332:0:15105:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996a42fca000): rc 0 00000020:00000080:2.0:1787388144.278336:0:15105:0:(genops.c:906:class_export_put()) final put ffff996a42fca000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787388144.278371:0:15105:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff996a41f5d000), last request at 1787388139 00000020:00000080:2.0:1787388144.278378:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447422e 00000100:00080000:2.0:1787388144.278386:0:15105:0:(import.c:65:import_set_state_nolock()) ffff996a41f5a000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787388144.278406:0:15105:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996a41f5d000): rc 0 00000020:00000080:2.0:1787388144.278408:0:15105:0:(genops.c:906:class_export_put()) final put ffff996a41f5d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787388144.278413:0:15105:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff996b74c0a800), last request at 1787387898 00000020:00000080:2.0:1787388144.278416:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447412b 00000100:00080000:2.0:1787388144.278419:0:15105:0:(import.c:65:import_set_state_nolock()) ffff996b74c0e000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787388144.278424:0:15105:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996b74c0a800): rc 0 00000020:00000080:2.0:1787388144.278425:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b74c0a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787388144.278429:0:15105:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff996b44968800), last request at 1787387897 00000020:00000080:2.0:1787388144.278431:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44740f3 00000100:00080000:2.0:1787388144.278435:0:15105:0:(import.c:65:import_set_state_nolock()) ffff996b73a89000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787388144.278440:0:15105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1787388144.278634:0:15105:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996b44968800): rc 0 00000004:00000080:2.0:1787388144.278706:0:15105:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa5d547aa7ae0 00000100:00080000:2.0:1787388144.278726:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787388144.278729:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1787388144.278857:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787388144.279720:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42fca000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787388144.279774:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a41f5d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787388144.279792:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b74c0a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787388144.279820:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a42fcd000 for lustre-MDT0000 00000020:00000080:3.0:1787388144.279824:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a41f5a000 for lustre-MDT0000 00000020:00000080:3.0:1787388144.279828:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b74c0e000 for lustre-MDT0000 00010000:00010000:3.0:1787388144.279845:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787388144.280298:0:15105:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787388144.280319:0:15105:0:(import.c:65:import_set_state_nolock()) ffff996b7bf30800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787388144.280394:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945745920:0@lo:39:umount.0 00000100:00100000:1.0:1787388144.280469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388144.280529:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945745920 00000100:00100000:1.0:1787388144.280538:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945745920 00000001:00100000:0.0:1787388144.280567:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787388144.280572:0:6500:0:(genops.c:906:class_export_put()) final put ffff996b44968800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787388144.280587:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000001:00080000:0.0:1787388144.280597:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000100:00100000:1.0:1787388144.280598:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000020:00000080:0.0:1787388144.280600:0:6500:0:(genops.c:906:class_export_put()) final put ffff996a42fcc800/b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000001:00100000:0.0:1787388144.280608:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000100:00100000:1.0:1787388144.280613:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874211945745920:12345-0@lo:39:umount.0 00000001:00080000:0.0:1787388144.280617:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1787388144.280627:0:6500:0:(genops.c:906:class_export_put()) final put ffff996a420ce800/00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:1.0:1787388144.280641:0:6526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474186 00000100:00080000:1.0:1787388144.280650:0:6526:0:(import.c:65:import_set_state_nolock()) ffff996b4496c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787388144.280682:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000020:00000080:0.0:1787388144.280684:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b44968800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787388144.280720:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42fcc800/b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 for lustre-MDT0000 00000020:00000080:0.0:1787388144.280744:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a420ce800/00e97fed-41ea-4716-be07-f037d23906cf for lustre-MDT0000 00000020:00000080:0.0:1787388144.280775:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b73a89000 for lustre-MDT0000 00000020:00000080:0.0:1787388144.280780:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a42fcd800 for lustre-MDT0000 00000020:00000080:0.0:1787388144.280783:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a420ca800 for lustre-MDT0000 00010000:00010000:0.0:1787388144.280798:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388144.280820:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3648:x1874211945745920:12345-0@lo:39:umount.0 Request processed in 211us (351us total) trans 4294967301 rc 0/0 00000100:00080000:0.0:1787388144.280835:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b7bf30800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787388144.280844:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945745920:0@lo:39:umount.0 00000100:00100000:1.0:1787388144.280845:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:2.0:1787388144.283787:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787388144.283795:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787388144.283839:0:15105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787388144.283898:0:15105:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787388144.283924:0:15105:0:(import.c:65:import_set_state_nolock()) ffff996a41f58800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787388144.283945:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787388144.283948:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000100:00100000:0.0:1787388144.284037:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945746048:0@lo:9:umount.0 00000100:00100000:0.0:1787388144.284097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787388144.284214:0:15105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787388144.284276:0:15105:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787388144.284287:0:15105:0:(import.c:65:import_set_state_nolock()) ffff996a4339d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787388144.284320:0:15105:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff996b450e19c0) has no exports 00000100:00100000:1.0:1787388144.285158:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945746048 00000100:00100000:1.0:1787388144.285169:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945746048 00000100:00100000:1.0:1787388144.285248:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787388144.285259:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874211945746048:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787388144.285286:0:8434:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44742d6 00000100:00080000:1.0:1787388144.285295:0:8434:0:(import.c:65:import_set_state_nolock()) ffff996b74f96000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787388144.285340:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787388144.285500:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3648:x1874211945746048:12345-0@lo:9:umount.0 Request processed in 243us (1402us total) trans 0 rc 0/0 00000100:00080000:3.0:1787388144.286511:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388144.286722:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787388144.286875:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945746176:0@lo:9:umount.0 00000100:00100000:0.0:1787388144.286930:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787388144.286984:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a41f58800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787388144.286994:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787388144.286996:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787388144.286999:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945746048:0@lo:9:umount.0 00010000:00010000:0.0:1787388144.287735:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388144.287840:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945746176 00000100:00100000:1.0:1787388144.287848:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945746176 00000100:00100000:1.0:1787388144.287913:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787388144.287922:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874211945746176:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787388144.287947:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474418 00000100:00080000:1.0:1787388144.287955:0:8437:0:(import.c:65:import_set_state_nolock()) ffff996a43398800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787388144.287994:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787388144.288859:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3648:x1874211945746176:12345-0@lo:9:umount.0 Request processed in 934us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388144.288867:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:1.0:1787388144.288894:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787388144.288919:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a4339d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787388144.288930:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787388144.288932:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787388144.288936:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945746176:0@lo:9:umount.0 00000100:00080000:3.0:1787388144.289386:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1787388144.303987:0:15105:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff996b450e19c0) has no exports 00000020:00000080:2.0:1787388144.372323:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4473ffe 00000020:00000080:2.0:1787388144.372337:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b5ddee000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787388144.372497:0:15105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787388144.374263:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388144.374279:0:15105:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787388144.374284:0:15105:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff996b73883380) has no exports 00000020:00000080:2.0:1787388144.375485:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4473ff7 00000020:00000080:2.0:1787388144.375495:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b7388e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787388144.376061:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b5ddee000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787388144.381199:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7388e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787388144.384154:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388144.384171:0:15105:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787388144.384177:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b7388c000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787388144.384182:0:15105:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7388c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787388144.384194:0:15105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1787388144.384330:0:15105:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996a430938a0 - data ffff996b6b78fca8/ffff996b74eb8000 00000020:01000000:2.0:1787388144.385301:0:15105:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996b5ed4d540 - data ffff996b6b4abca8/ffff996b73a86000 00000001:00000004:0.0:1787388144.404924:0:15105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1787388144.458451:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787388144.458459:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787388144.458473:0:15105:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff996b72b5bb80 x1874211945745920/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787388154 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388144.458496:0:15105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787388144.459956:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787388144.459960:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1787388144.459978:0:15105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787388144.459980:0:15105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787388144.460250:0:8487:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787388144.460256:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1787388144.460266:0:8487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787388144.461007:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787388144.461011:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1787388144.461233:0:15105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787388144.461236:0:15105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787388144.461672:0:9844:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787388144.461676:0:9844:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1787388144.461684:0:9844:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787388144.462653:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4473fc6 00000020:00000080:0.0:1787388144.462673:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b44937000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787388144.463098:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b44937000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787388144.467949:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4473fdb 00000020:00000080:0.0:1787388144.467963:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b449d0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787388144.468010:0:15105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787388144.468016:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388144.468032:0:15105:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787388144.468036:0:15105:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff996b450e4d40) has no exports 00000004:01000000:0.0:1787388144.468201:0:15105:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787388144.468209:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474411 00000020:00000080:0.0:1787388144.468213:0:15105:0:(genops.c:906:class_export_put()) final put ffff996a420c9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787388144.469686:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b449d0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787388144.471816:0:15105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787388144.472440:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a420c9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787388144.473441:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388144.473458:0:15105:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787388144.473463:0:15105:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff996a4338cd40) has no exports 00000020:00000080:0.0:1787388144.473472:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447440a 00000020:00000080:0.0:1787388144.473491:0:15105:0:(genops.c:906:class_export_put()) final put ffff996a4339a000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787388144.473941:0:15105:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787388144.473947:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787388144.473951:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1787388144.473956:0:15105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787388144.473958:0:15105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787388144.473995:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388144.474004:0:15105:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787388144.474012:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44742cf 00000020:00000080:0.0:1787388144.474044:0:15105:0:(genops.c:906:class_export_put()) final put ffff996a41c58000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787388144.474140:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a4339a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787388144.474148:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a4339d800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787388144.474160:0:38:0:(genops.c:906:class_export_put()) final put ffff996a4310b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787388144.474162:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a4310b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787388144.474166:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787388144.474244:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a41c58000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787388144.474650:0:15105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787388144.474665:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388144.474672:0:15105:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787388144.474675:0:15105:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff996a420c4d40) has no exports 00000020:00000080:0.0:1787388144.474680:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44742c8 00000020:00000080:0.0:1787388144.474685:0:15105:0:(genops.c:906:class_export_put()) final put ffff996a41f5e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787388144.474886:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a41f5e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787388144.476169:0:15105:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787388144.476176:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787388144.476179:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1787388144.476186:0:15105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787388144.476188:0:15105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787388144.476718:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388144.476730:0:15105:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787388144.476745:0:15105:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787388144.476752:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447417f 00000020:00000080:0.0:1787388144.476761:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b73a8a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787388144.478201:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a41f58800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787388144.478214:0:38:0:(genops.c:906:class_export_put()) final put ffff996a420cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787388144.478217:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a420cd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787388144.478224:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787388144.482384:0:15105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787388144.482398:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388144.482412:0:15105:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787388144.482417:0:15105:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff996b7bdf8000) has no exports 00000020:00000080:0.0:1787388144.482427:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474178 00000020:00000080:0.0:1787388144.482436:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b7bf35000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787388144.484962:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b73a8a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787388144.490598:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7bf35000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787388144.532747:0:15105:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787388144.532755:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787388144.532760:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787388144.532767:0:15105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787388144.532819:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388144.532844:0:15105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787388144.532868:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388144.532871:0:15105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787388144.532876:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b44935000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787388144.532881:0:15105:0:(genops.c:865:class_export_destroy()) destroying export ffff996b44935000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787388144.532893:0:15105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787388144.532988:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4473fe2 00000020:00000080:2.0:1787388144.532995:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b449d5800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787388144.532999:0:15105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787388144.533002:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388144.533027:0:15105:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787388144.533031:0:15105:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff996b450e3380) has no exports 00000020:00000080:2.0:1787388144.533048:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388144.533051:0:15105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787388144.533055:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4473fe9 00000020:00000080:2.0:1787388144.533060:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b449d2000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787388144.533068:0:15105:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b46a34000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787388144.533072:0:15105:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b46a34000 3 00000020:01000004:2.0:1787388144.533075:0:15105:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff996b46a34000 from lustre-MDT0000 00000020:00000080:2.0:1787388144.533092:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388144.533095:0:15105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787388144.533098:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b44930800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787388144.533100:0:15105:0:(genops.c:865:class_export_destroy()) destroying export ffff996b44930800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787388144.533106:0:15105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787388144.533137:0:15105:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787388144.533140:0:15105:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787388144.533143:0:15105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787388144.533145:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388144.533148:0:15105:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787388144.533154:0:15105:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff996b62090800 530741c0-7948-4b28-86b1-ece4c1322eb9 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787388144.533159:0:15105:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff996b72b84d40) has exports, disconnecting them 00000020:00080000:2.0:1787388144.533163:0:15105:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff996b62090800), last request at 1787387879 00000020:00000080:2.0:1787388144.533176:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4473f87 00000020:00010000:2.0:1787388144.533179:0:15105:0:(genops.c:1942:obd_stale_export_put()) Put export ffff996b62090800: total 2 00000100:00080000:2.0:1787388144.533183:0:15105:0:(import.c:65:import_set_state_nolock()) ffff996b461c4800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787388144.533199:0:15105:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996b62090800): rc 0 00000020:00080000:2.0:1787388144.533203:0:15105:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff996b72b84d40) has no exports 00000100:00100000:2.0:1787388144.533279:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff996b45177800:6515] 1 exiting: rc = 0 00000020:00000080:2.0:1787388144.533365:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b7bf30800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787388144.533372:0:38:0:(genops.c:906:class_export_put()) final put ffff996b7bf34000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787388144.533375:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7bf34000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1787388144.533384:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787388144.533421:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b449d5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787388144.533425:0:38:0:(genops.c:906:class_export_put()) final put ffff996b449d3000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787388144.533428:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b449d3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787388144.533431:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787388144.533454:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b449d2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1787388144.533500:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff996b45177000:6514] 0 exiting: rc = 1 00000020:00010000:0.0:1787388144.539734:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff996b62090800: total 0 00010000:00010000:0.0:1787388144.539821:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff996b62090800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787388144.539863:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40031e00/0x26817551a4474091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a447408a expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.539924:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70077000/0x26817551a447471a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a4474713 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.539938:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b414a2e00/0x26817551a44744ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a44744c7 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.539966:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40030e00/0x26817551a4474083 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a447407c expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.539982:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e5200/0x26817551a4474736 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a447472f expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.539994:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e4a00/0x26817551a4474728 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a4474721 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.540008:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e4600/0x26817551a44744f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a44744f1 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.540019:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e09e00/0x26817551a4474488 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a4474481 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.540032:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b74e08600/0x26817551a4474496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a447448f expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.540044:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b413ff800/0x26817551a44743a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a44743a1 expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.540059:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b414a3000/0x26817551a44744a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a447449d expref: 4 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.540075:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a431e4400/0x26817551a44744b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a44744ab expref: 3 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.540091:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70077600/0x26817551a44744c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26817551a44744b9 expref: 2 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388144.540119:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff996b62090800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787388144.540135:0:6510:0:(genops.c:906:class_export_put()) final put ffff996b62090800/530741c0-7948-4b28-86b1-ece4c1322eb9 00000020:00000080:2.0:1787388144.540177:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b62090800/530741c0-7948-4b28-86b1-ece4c1322eb9 for MGS 00000020:00000080:2.0:1787388144.540225:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b461c4800 for MGS 00010000:00010000:0.0:1787388144.540680:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388144.540684:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388144.540687:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388144.540734:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff996b43944c00:6516] 2 exiting: rc = 0 00000100:00100000:2.0:1787388144.542671:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542686:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542693:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542700:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542707:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542715:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542724:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542731:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542738:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542745:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542753:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542760:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542767:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542774:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542781:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542789:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542797:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542806:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542814:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542821:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542833:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542844:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542853:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542875:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542897:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542928:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542933:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542939:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542948:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542955:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542961:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542966:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542971:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542976:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542982:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542987:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542992:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.542997:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543002:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543007:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543013:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543019:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543025:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543029:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543034:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543039:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543050:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543056:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543061:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543067:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543072:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543077:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543084:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543088:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543093:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543098:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543106:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543113:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543125:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543129:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543135:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543141:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543146:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388144.543151:0:15105:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787388144.544044:0:15105:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996b7ac796c0 - data ffff996b6b78e288/ffff996a43391800 00000020:01000000:2.0:1787388144.544158:0:15105:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996b468a9d80 - data ffff996b51ff31b0/ffff996b461bf400 00000020:00000080:2.0:1787388144.544607:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4473f6b 00000020:00000080:2.0:1787388144.544617:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b452fb800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787388144.544632:0:15105:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b46a34000 from MGS, refs=2 00000020:01000004:2.0:1787388144.544635:0:15105:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b46a34000 2 00000020:01000004:2.0:1787388144.544638:0:15105:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff996b46a34000 from MGS 00000020:00000080:2.0:1787388144.544669:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388144.544676:0:15105:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787388144.544678:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b4a9b1800/MGS 00000020:00000080:2.0:1787388144.544680:0:15105:0:(genops.c:865:class_export_destroy()) destroying export ffff996b4a9b1800/MGS for MGS 00000020:01000000:2.0:1787388144.544686:0:15105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787388144.544744:0:15105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787388144.544748:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388144.544754:0:15105:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787388144.544760:0:15105:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff996b73977000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787388144.544765:0:15105:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff996b739ccd40) has exports, disconnecting them 00000020:00080000:2.0:1787388144.544770:0:15105:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff996b73977000), last request at 1787387879 00000020:00000080:2.0:1787388144.544773:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474036 00000020:00080000:2.0:1787388144.544782:0:15105:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996b73977000): rc 0 00000020:00000080:2.0:1787388144.544786:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b73977000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787388144.544900:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b452fb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787388144.544914:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b73977000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787388144.550174:0:15105:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787388144.550183:0:15105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787388144.550187:0:15105:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787388144.550194:0:15105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787388144.550221:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b73970000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787388144.550385:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388144.550393:0:15105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787388144.550399:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b5dded800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787388144.550404:0:15105:0:(genops.c:865:class_export_destroy()) destroying export ffff996b5dded800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787388144.550410:0:15105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787388144.550479:0:15105:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b46a34000 1 00000020:00000080:3.0:1787388144.550484:0:15105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4473f5d 00000020:00000080:3.0:1787388144.550491:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b46a35800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787388144.550502:0:15105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787388144.550646:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b46a35800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787388144.550669:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388144.550675:0:15105:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787388144.550680:0:15105:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff996b72b80000) has no exports 00000020:00000080:1.0:1787388144.601244:0:15105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787388144.601257:0:15105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787388144.601263:0:15105:0:(genops.c:906:class_export_put()) final put ffff996b46a35000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787388144.601267:0:15105:0:(genops.c:865:class_export_destroy()) destroying export ffff996b46a35000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787388144.601274:0:15105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787388144.601401:0:15105:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff996b46a32800 00000020:02000400:1.0:1787388144.601457:0:15105:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1787388144.878682:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388144.878705:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945746304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388144.878769:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.878826:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945746304 00000100:00100000:2.0:1787388144.878840:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945746304 00000100:00100000:2.0:1787388144.878911:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787388144.878920:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945746304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388144.878948:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787388144.878992:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945746304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388144.879000:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1787388144.879192:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388144.879231:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945746304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388144.883715:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945746432:0@lo:400:kworker.0 00000400:00000100:2.0:1787388144.883763:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874211945746432 offset 0 length 224: 4 00000100:00100000:2.0:1787388144.883795:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945746944:0@lo:400:kworker.0 00000100:00100000:2.0:1787388144.883821:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.883845:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787388144.883851:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945746560:0@lo:400:kworker.0 00000100:00100000:2.0:1787388144.883884:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.883913:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945747072:0@lo:400:kworker.0 00000100:00100000:2.0:1787388144.883939:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.883969:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945746944 00000100:00100000:2.0:1787388144.883975:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945746944 00000100:00100000:2.0:1787388144.884456:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1787388144.884479:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945746944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388144.884535:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945746944:12345-0@lo:400:kworker.0 Request processed in 70us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388144.884543:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1787388144.884583:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945746560 00000100:00100000:2.0:1787388144.884588:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945746560 00000100:00100000:2.0:1787388144.884611:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787388144.884617:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1874211945746560:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787388144.884623:0:6525:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787388144.884650:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1874211945746560:12345-0@lo:400:kworker.0 Request processed in 32us (777us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787388144.884665:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:2.0:1787388144.884689:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388144.884701:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945746688:0@lo:400:kworker.0 00000100:00100000:2.0:1787388144.884726:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.884744:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945747200:0@lo:400:kworker.0 00000100:00100000:2.0:1787388144.884764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.884781:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787388144.884787:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945746816:0@lo:400:kworker.0 00000100:00100000:2.0:1787388144.884808:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.884823:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945747328:0@lo:400:kworker.0 00000100:00100000:2.0:1787388144.884843:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.884864:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945746688 00000100:00100000:2.0:1787388144.884868:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945746688 00000100:00100000:2.0:1787388144.885086:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945747200 00000100:00100000:2.0:1787388144.885091:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945747200 00000100:00100000:2.0:1787388144.885101:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945746816 00000100:00100000:2.0:1787388144.885103:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945746816 00000100:00100000:2.0:1787388144.885111:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945747328 00000100:00100000:2.0:1787388144.885113:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945747328 00000100:00100000:2.0:1787388144.885133:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787388144.885139:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945747328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388144.885185:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945747328:12345-0@lo:400:kworker.0 Request processed in 45us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388144.885191:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787388144.885205:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787388144.885209:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1874211945746688:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787388144.885213:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787388144.885234:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1874211945746688:12345-0@lo:400:kworker.0 Request processed in 23us (506us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787388144.885239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787388144.885249:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787388144.885252:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1874211945747200:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787388144.885257:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787388144.885276:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1874211945747200:12345-0@lo:400:kworker.0 Request processed in 22us (512us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787388144.885282:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787388144.885293:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787388144.885296:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1874211945746816:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787388144.885301:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787388144.885322:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1874211945746816:12345-0@lo:400:kworker.0 Request processed in 24us (513us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787388144.885327:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1787388144.885364:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388144.885392:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787388144.885397:0:3649:0:(import.c:65:import_set_state_nolock()) ffff996b7ad10800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787388144.885401:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787388144.886165:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945747072 00000100:00100000:1.0:1787388144.886171:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945747072 00000100:00100000:1.0:1787388144.886222:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787388144.886230:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945747072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388144.886273:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945747072:12345-0@lo:400:kworker.0 Request processed in 45us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388144.886279:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1787388144.886410:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787388144.887435:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787388144.887440:0:3651:0:(import.c:65:import_set_state_nolock()) ffff996a41f5a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787388144.887444:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787388144.887449:0:3651:0:(import.c:65:import_set_state_nolock()) ffff996a41f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388144.887453:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 242 00000100:00080000:3.0:1787388144.887460:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff996a41f5a800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388144.887502:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ac380 x1874211945747456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787388144.887526:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945746816:0@lo:400:kworker.0 00010000:00080000:3.0:1787388144.887542:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43b9e680 x1874211945747328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388144.887553:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945747328:0@lo:400:kworker.0 00000100:00080000:3.0:1787388144.887564:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787388144.887567:0:3651:0:(import.c:65:import_set_state_nolock()) ffff996b74c09800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787388144.887570:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787388144.887574:0:3651:0:(import.c:65:import_set_state_nolock()) ffff996b74c09800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388144.887577:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 219 00000100:00080000:3.0:1787388144.887581:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff996b74c09800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388144.887592:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412af480 x1874211945747584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787388144.887615:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945746688:0@lo:400:kworker.0 00000100:00080000:3.0:1787388144.887629:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787388144.887632:0:3651:0:(import.c:65:import_set_state_nolock()) ffff996a43026000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787388144.887636:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787388144.887638:0:3651:0:(import.c:65:import_set_state_nolock()) ffff996a43026000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388144.887641:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 265 00000100:00080000:3.0:1787388144.887645:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff996a43026000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388144.887668:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ac700 x1874211945747712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787388144.887679:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1874211945747200:0@lo:400:kworker.0 00000100:00100000:1.0:1787388144.887885:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1874211945747456:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787388144.888119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388144.888153:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874211945747584:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787388144.888175:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388144.888193:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1874211945747712:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787388144.888228:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388144.888258:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945747456 00000100:00100000:1.0:1787388144.888263:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945747456 00000100:00100000:1.0:1787388144.888288:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945747584 00000100:00100000:1.0:1787388144.888291:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945747584 00000100:00100000:1.0:1787388144.888304:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945747712 00000100:00100000:1.0:1787388144.888307:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945747712 00000100:00100000:1.0:1787388144.888319:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787388144.888325:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874211945747456:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1787388144.888366:0:6521:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787388144.888405:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874211945747456:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 79us (286us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787388144.888412:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787388144.888425:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787388144.888429:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874211945747584:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1787388144.888438:0:6521:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787388144.888460:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874211945747584:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 30us (284us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787388144.888465:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787388144.888779:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787388144.888784:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1874211945747712:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1787388144.888795:0:6520:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787388144.888823:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1874211945747712:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 38us (595us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787388144.888830:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1787388144.888921:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a41f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388144.888926:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787388144.888930:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1874211945747456:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787388144.888939:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b74c09800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388144.888942:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787388144.888944:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874211945747584:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787388144.888950:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a43026000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388144.888959:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787388144.888962:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1874211945747712:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1787388144.902841:0:3649:0:(import.c:65:import_set_state_nolock()) ffff996b7ad10800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787388144.902868:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 219 00000100:00080000:2.0:1787388144.902894:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff996b7ad10800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787388144.903087:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f5e2680 x1874211945747840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787388144.903143:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945747840:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787388144.903210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388144.903334:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945746560:0@lo:400:kworker.0 00000100:00100000:2.0:1787388144.903924:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945747072:0@lo:400:kworker.0 00010000:00080000:2.0:1787388144.903942:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c0c8380 x1874211945746944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388144.903951:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945746944:0@lo:400:kworker.0 00000100:00100000:1.0:1787388144.905620:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945747840 00000100:00100000:1.0:1787388144.905632:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945747840 00000100:00100000:1.0:1787388144.905688:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787388144.905696:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1874211945747840:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1787388144.905722:0:6526:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787388144.905799:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1874211945747840:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 102us (2588us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787388144.905807:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:1.0:1787388144.906118:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b7ad10800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388144.906125:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787388144.906128:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945747840:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1787388145.262242:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388146.286456:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787388146.419848:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787388146.419875:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1787388146.419880:0:7451:0:(genops.c:906:class_export_put()) final put ffff996b4496c800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787388146.419892:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000001:00080000:2.0:1787388146.419897:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1787388146.419899:0:7451:0:(genops.c:906:class_export_put()) final put ffff996a42fc8000/b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 00000001:00100000:2.0:1787388146.419903:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000001:00080000:2.0:1787388146.419906:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1787388146.419908:0:7451:0:(genops.c:906:class_export_put()) final put ffff996a420cf000/00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:2.0:1787388146.419919:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b4496c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:1.0:1787388146.420417:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787388146.420421:0:9514:0:(genops.c:906:class_export_put()) final put ffff996a4339e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787388146.420946:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42fc8000/b62f6a8b-2ad2-4bdc-a970-3ca92e68d862 for lustre-MDT0001 00000001:00100000:1.0:1787388146.424129:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:1.0:1787388146.424138:0:9514:0:(genops.c:906:class_export_put()) final put ffff996a44055800/00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:2.0:1787388146.425155:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a420cf000/00e97fed-41ea-4716-be07-f037d23906cf for lustre-MDT0001 00000001:00100000:1.0:1787388146.425682:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787388146.425687:0:8430:0:(genops.c:906:class_export_put()) final put ffff996b74f92800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787388146.425699:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:1.0:1787388146.425702:0:8430:0:(genops.c:906:class_export_put()) final put ffff996a43206800/00e97fed-41ea-4716-be07-f037d23906cf 00000020:00000080:2.0:1787388146.425825:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b4496c000 for lustre-MDT0001 00000020:00000080:2.0:1787388146.425831:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a4339e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787388146.426160:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a44055800/00e97fed-41ea-4716-be07-f037d23906cf for lustre-OST0001 00000020:00000080:2.0:1787388146.426189:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a42fce800 for lustre-MDT0001 00000020:00000080:2.0:1787388146.426193:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a4310b000 for lustre-MDT0001 00000020:00000080:2.0:1787388146.426197:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b74f92800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787388146.426282:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a43206800/00e97fed-41ea-4716-be07-f037d23906cf for lustre-OST0000 00000020:00000080:2.0:1787388146.426311:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a43398800 for lustre-OST0001 00000020:00000080:2.0:1787388146.426315:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a44052000 for lustre-OST0001 00000020:00000080:2.0:1787388146.426319:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b74f96000 for lustre-OST0000 00000020:00000080:2.0:1787388146.426322:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a43200800 for lustre-OST0000 00000100:00100000:0.0:1787388146.924727:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945747968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388146.924798:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388146.924915:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945747968 00000100:00100000:1.0:1787388146.924930:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945747968 00000100:00100000:1.0:1787388146.924998:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787388146.925008:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945747968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388146.925036:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787388146.925099:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945747968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388146.925106:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1787388146.925229:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388146.925277:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945747968:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787388147.312680:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787388147.876016:0:15306:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787388147.897587:0:15306:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787388147.897653:0:15306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.897667:0:15306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.897674:0:15306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.897681:0:15306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.897745:0:15306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787388147.897752:0:15306:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787388147.897779:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787388147.897784:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787388147.897801:0:15306:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787388147.897816:0:15306:0:(import.c:65:import_set_state_nolock()) ffff996b74c09800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787388147.897822:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787388147.897823:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787388147.897826:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787388147.898697:0:15306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.898710:0:15306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.898717:0:15306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.898723:0:15306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.899752:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388147.899762:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.899771:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08a00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388147.899775:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.899784:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388147.899791:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388147.899797:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787388147.899810:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787388147.899813:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787388147.899951:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.899958:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787388147.900075:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945748096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388147.900142:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388147.900226:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945748096 00000100:00100000:1.0:1787388147.900233:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945748096 00000100:00100000:1.0:1787388147.900273:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787388147.900281:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b46ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1874211945748096:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787388147.900287:0:7462:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787388147 with bad export cookie 2774627838945869703 00010000:00010000:0.0:1787388147.901664:0:15306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388147.901683:0:15306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901693:0:15306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901701:0:15306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901707:0:15306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901736:0:15306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787388147.901794:0:15306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901802:0:15306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901809:0:15306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901815:0:15306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901823:0:15306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787388147.901828:0:15306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901835:0:15306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901842:0:15306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901848:0:15306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.901855:0:15306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787388147.901858:0:15306:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1787388147.901902:0:15306:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787388147.901906:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787388147.901910:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388147.901916:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787388147.901922:0:15306:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff996a42fc9800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787388147.901927:0:15306:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff996a41c5d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787388147.901932:0:15306:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff996b73b419c0) has exports, disconnecting them 00000020:00080000:0.0:1787388147.901935:0:15306:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff996a42fc9800), last request at 1787388144 00000020:00000080:0.0:1787388147.901943:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474369 00010000:00010000:2.0:1787388147.901948:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787388147.901959:0:15306:0:(import.c:65:import_set_state_nolock()) ffff996a42fcb800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787388147.901962:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e08a00/0x26817551a44744b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.901976:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787388147.901980:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.901987:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076800 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388147.901990:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.901998:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787388147.901998:0:15306:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996a42fc9800): rc 0 00000020:00000080:0.0:1787388147.902001:0:15306:0:(genops.c:906:class_export_put()) final put ffff996a42fc9800/lustre-MDT0001-lwp-OST0001_UUID 10000000:00010000:2.0:1787388147.902005:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388147.902010:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00080000:0.0:1787388147.902011:0:15306:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff996a41c5d800), last request at 1787388144 10000000:01000000:2.0:1787388147.902013:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00000020:00000080:0.0:1787388147.902014:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474243 10000000:01000000:2.0:1787388147.902015:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000100:00080000:0.0:1787388147.902018:0:15306:0:(import.c:65:import_set_state_nolock()) ffff996a41c5d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787388147.902023:0:15306:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996a41c5d800): rc 0 00000020:00000080:0.0:1787388147.902025:0:15306:0:(genops.c:906:class_export_put()) final put ffff996a41c5d800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787388147.902032:0:15306:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa5d54149fae0 00010000:00010000:2.0:1787388147.902042:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902047:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1787388147.902048:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1787388147.902066:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902072:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70076800/0x26817551a44744c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44744ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902090:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787388147.902093:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902099:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b413ffe00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388147.902102:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902108:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388147.902114:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388147.902119:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787388147.902121:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787388147.902124:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787388147.902138:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902143:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388147.902149:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902155:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b413ffe00/0x26817551a44743a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a44743a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902167:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388147.902170:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902181:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08400 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388147.902183:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902189:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388147.902195:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388147.902199:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787388147.902201:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787388147.902203:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787388147.902214:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.902219:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787388147.902415:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1787388147.903596:0:15306:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787388147.903603:0:15306:0:(import.c:65:import_set_state_nolock()) ffff996b7ad10800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1787388147.903660:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1787388147.903795:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787388147.903799:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1787388147.903809:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787388147.903866:0:15306:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787388147.903884:0:15306:0:(import.c:65:import_set_state_nolock()) ffff996b74f91800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787388147.903897:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787388147.903910:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1787388147.903918:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787388147.903964:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1787388147.903971:0:15306:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787388147.903981:0:15306:0:(import.c:65:import_set_state_nolock()) ffff996a4310d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787388147.903987:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945748480:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787388147.904001:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff996b73b419c0) has no exports 00000100:00100000:3.0:1787388147.904045:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388147.904096:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945748480 00000100:00100000:3.0:1787388147.904109:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945748480 00000100:00100000:3.0:1787388147.904140:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787388147.904147:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1874211945748480:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787388147.904154:0:6508:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787388147 with bad export cookie 2774627838945869703 00000100:00100000:3.0:1787388147.904197:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1874211945748480:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (151us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787388147.904204:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787388147.904223:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945748224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388147.904245:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388147.904260:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388147.904267:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945748352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388147.904284:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388147.904299:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945748224 00000100:00100000:3.0:1787388147.904302:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945748224 00000100:00100000:3.0:1787388147.904313:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945748352 00000100:00100000:3.0:1787388147.904315:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945748352 00000100:00100000:3.0:1787388147.904322:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787388147.904326:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1874211945748224:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787388147.904330:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787388147 with bad export cookie 2774627838945869703 00000100:00100000:3.0:1787388147.904373:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1874211945748224:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (127us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787388147.904379:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787388147.904390:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787388147.904394:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1874211945748352:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787388147.904397:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787388147 with bad export cookie 2774627838945869703 00000100:00100000:3.0:1787388147.904421:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1874211945748352:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (135us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787388147.904435:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787388147.904466:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.115@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787388147.904470:0:3651:0:(import.c:65:import_set_state_nolock()) ffff996b5dcf0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787388147.904473:0:3651:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.115@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1787388147.904524:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945748608:0@lo:9:umount.0 00000100:00100000:0.0:1787388147.904613:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388147.904615:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388147.904625:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e08400/0x26817551a447472f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4474736 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388147.904646:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945748736:0@lo:9:umount.0 00010000:00010000:2.0:1787388147.904650:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388147.904651:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388147.904653:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388147.904668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388147.904698:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945748608 00000100:00100000:0.0:1787388147.904702:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945748608 00000100:00100000:0.0:1787388147.904728:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945748736 00000100:00100000:0.0:1787388147.904731:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945748736 00000100:00100000:0.0:1787388147.904753:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787388147.904758:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874211945748608:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787388147.904780:0:8490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474290 00000100:00080000:0.0:1787388147.904788:0:8490:0:(import.c:65:import_set_state_nolock()) ffff996b44930000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787388147.904821:0:8490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1787388147.904940:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3648:x1874211945748608:12345-0@lo:9:umount.0 Request processed in 181us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388147.904946:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787388147.904958:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787388147.904964:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874211945748736:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787388147.904975:0:8490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44743d2 00000100:00080000:0.0:1787388147.904981:0:8490:0:(import.c:65:import_set_state_nolock()) ffff996a43109000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787388147.904995:0:8490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787388147.905267:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3648:x1874211945748736:12345-0@lo:9:umount.0 Request processed in 303us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388147.905283:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1787388147.905301:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787388147.905319:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787388147.905432:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b74f91800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787388147.905441:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787388147.905444:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787388147.905448:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945748608:0@lo:9:umount.0 00000100:00080000:0.0:1787388147.905459:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a4310d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787388147.905467:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787388147.905468:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787388147.905471:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945748736:0@lo:9:umount.0 00000020:00000080:2.0:1787388147.905582:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42fc9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1787388147.905621:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a41c5d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787388147.905656:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a42fcb800 for lustre-MDT0001 00000020:00000080:2.0:1787388147.905666:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a41c5d000 for lustre-MDT0001 00010000:00010000:2.0:1787388147.905698:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388147.905700:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388147.905701:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787388147.905744:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.115@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787388147.908026:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b46ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1874211945748096:12345-0@lo:103:ldlm_bl.0 Request processed in 7741us (7880us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787388147.908037:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787388147.908220:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.908231:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076c00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787388147.908236:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388147.908244:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388147.908251:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388147.908256:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787388147.908259:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787388147.908262:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:3.0:1787388147.919341:0:3651:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.115@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787388147.919437:0:3651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787388147.919446:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b72b5bb80 x1874211945746432/t0(0) o400->MGC192.168.203.115@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787388160 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388147.919467:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b7f5e3800 x1874211945748096/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787388163 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388147.919477:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b7f5e0700 x1874211945748480/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787388163 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388147.919485:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b7f5e2a00 x1874211945748224/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787388163 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388147.919494:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b7f5e3b80 x1874211945748352/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787388163 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787388147.919579:0:3650:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff996b5dcf0000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787388147.919604:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945748096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388147.919643:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:3650:1874211945748480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388147.919684:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:530741c0-7948-4b28-86b1-ece4c1322eb9:3649:1874211945746432:0@lo:400:kworker.0 10000000:01000000:3.0:1787388147.919692:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787388147.919696:0:3651:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787388147.919697:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787388147.919700:0:3651:0:(import.c:65:import_set_state_nolock()) ffff996b5dcf0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388147.919705:0:3651:0:(import.c:510:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 200 00000100:00080000:3.0:1787388147.919713:0:3651:0:(import.c:624:import_select_connection()) MGC192.168.203.115@tcp: import ffff996b5dcf0000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388147.919745:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412af100 x1874211945748864/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787388147.920318:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:530741c0-7948-4b28-86b1-ece4c1322eb9:3648:1874211945748864:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1787388147.920394:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874211945748864 offset 0 length 520: 4 00000100:00100000:3.0:1787388147.920459:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945748224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388147.920475:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:530741c0-7948-4b28-86b1-ece4c1322eb9:3651:1874211945748352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388147.922658:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388147.922673:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787388147.922732:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:530741c0-7948-4b28-86b1-ece4c1322eb9:0:1874211945748992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388147.922779:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388147.922789:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70076c00/0x26817551a447408a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26817551a4474091 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388147.922808:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388147.922810:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388147.922812:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787388147.927272:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff996b73b419c0) has no exports 00000020:01000000:3.0:1787388147.989377:0:15306:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996a430930c0 - data ffff996b6b78f0d8/ffff996b74eba800 00000020:01000000:3.0:1787388147.989660:0:15306:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996b739ba000 - data ffff996b6b602360/ffff996b7bf3dc00 00000001:00000004:3.0:1787388148.000922:0:15306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1787388148.059280:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787388148.059289:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787388148.059297:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787388148.061163:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787388148.061170:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787388148.061192:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787388148.061195:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787388148.061470:0:8482:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787388148.061475:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1787388148.061493:0:8482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787388148.062336:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787388148.062340:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787388148.062382:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787388148.062385:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787388148.063458:0:9840:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787388148.063463:0:9840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1787388148.063473:0:9840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787388148.069824:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44740ad 00000020:00000080:2.0:1787388148.069954:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b461c0800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787388148.073006:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44740c2 00000020:00000080:2.0:1787388148.073018:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b7ad16000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388148.073734:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b461c0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787388148.074937:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787388148.074948:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388148.074967:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787388148.074973:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff996b73b44d40) has no exports 00000004:01000000:2.0:1787388148.075152:0:15306:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787388148.075160:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44743cb 00000020:00000080:2.0:1787388148.075167:0:15306:0:(genops.c:906:class_export_put()) final put ffff996a42d85000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388148.075325:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7ad16000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787388148.075563:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787388148.075569:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388148.075576:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787388148.075579:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff996a420c3380) has no exports 00000020:00000080:2.0:1787388148.075586:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44743c4 00000020:00000080:2.0:1787388148.075591:0:15306:0:(genops.c:906:class_export_put()) final put ffff996a4310a000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787388148.075990:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42d85000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787388148.075999:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a4310a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787388148.076402:0:15306:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787388148.076407:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787388148.076411:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1787388148.076417:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787388148.076419:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787388148.076456:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388148.076464:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787388148.076471:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474289 00000020:00000080:2.0:1787388148.076476:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b44936800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787388148.076490:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787388148.076494:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388148.076499:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787388148.076502:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff996b72b83380) has no exports 00000020:00000080:2.0:1787388148.076508:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474282 00000020:00000080:2.0:1787388148.076511:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b74f93800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787388148.077076:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a4310d800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787388148.077085:0:38:0:(genops.c:906:class_export_put()) final put ffff996a42fcf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388148.077088:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42fcf000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787388148.077094:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388148.077178:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b44936800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787388148.077185:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b74f93800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787388148.077441:0:15306:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787388148.077445:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787388148.077447:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1787388148.077452:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787388148.077454:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787388148.077594:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388148.077611:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1787388148.077733:0:15306:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787388148.077741:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44740e5 00000020:00000080:2.0:1787388148.077747:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b7bf36800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787388148.077752:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1787388148.077756:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388148.078024:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787388148.078029:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff996b7bdfb380) has no exports 00000020:00000080:2.0:1787388148.078035:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44740de 00000020:00000080:2.0:1787388148.078039:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b7ad16800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787388148.078303:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b74f91800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787388148.078310:0:38:0:(genops.c:906:class_export_put()) final put ffff996b74f96800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388148.078313:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b74f96800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787388148.078319:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388148.078387:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7bf36800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787388148.078394:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7ad16800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787388148.080594:0:15306:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1787388148.080610:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787388148.080614:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1787388148.080637:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787388148.080687:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388148.080696:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388148.080720:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388148.080723:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388148.080727:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b7ace1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388148.080731:0:15306:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7ace1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787388148.080738:0:15306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787388148.083233:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b7ad10800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787388148.083250:0:38:0:(genops.c:906:class_export_put()) final put ffff996b7ad11800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787388148.083254:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7ad11800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787388148.083263:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388148.084424:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44740c9 00000020:00000080:3.0:1787388148.084435:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b7ad12800/lustre-MDD0001_UUID 00000020:01000000:3.0:1787388148.084450:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1787388148.084454:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388148.084464:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787388148.084468:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff996b73b43380) has no exports 00000020:00000080:1.0:1787388148.084572:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7ad12800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787388148.084625:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388148.084639:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1787388148.084642:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b7ad14000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787388148.084645:0:15306:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7ad14000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787388148.084650:0:15306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787388148.085104:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44740d0 00000020:00000080:3.0:1787388148.085111:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b7ad13000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1787388148.085163:0:15306:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b73aa7800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1787388148.085167:0:15306:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b73aa7800 2 00000020:01000004:3.0:1787388148.085170:0:15306:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff996b73aa7800 from lustre-MDT0001 00000020:00000080:3.0:1787388148.085196:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388148.085201:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1787388148.085204:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b461c6800/lustre-MDT0001_UUID 00000020:00000080:3.0:1787388148.085207:0:15306:0:(genops.c:865:class_export_destroy()) destroying export ffff996b461c6800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1787388148.085213:0:15306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1787388148.085250:0:15306:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1787388148.085254:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1787388148.085257:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388148.085261:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787388148.085268:0:15306:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff996b74c0b000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787388148.085273:0:15306:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff996b73880000) has exports, disconnecting them 00000020:00080000:3.0:1787388148.085277:0:15306:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff996b74c0b000), last request at 1787387897 00000020:00000080:3.0:1787388148.085281:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474124 00000020:00080000:3.0:1787388148.085292:0:15306:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996b74c0b000): rc 0 00000020:00000080:3.0:1787388148.085296:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b74c0b000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787388148.085362:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7ad13000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787388148.085560:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b74c0b000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787388148.122047:0:15306:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787388148.122055:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787388148.122060:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787388148.122067:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787388148.122238:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388148.122252:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787388148.122260:0:15306:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b73aa7800 1 00000020:00000080:2.0:1787388148.122269:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474060 00000020:00000080:2.0:1787388148.122278:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b73973000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787388148.122366:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b74c09800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787388148.122375:0:38:0:(genops.c:906:class_export_put()) final put ffff996b74c0f000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787388148.122378:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b74c0f000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787388148.122388:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:2.0:1787388148.122788:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787388148.122794:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787388148.122942:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996b73973000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787388148.123017:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787388148.123022:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff996b73b40000) has no exports 00000020:00000080:2.0:1787388148.230909:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388148.230923:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787388148.230929:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b73aa4800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787388148.230933:0:15306:0:(genops.c:865:class_export_destroy()) destroying export ffff996b73aa4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787388148.230945:0:15306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787388148.233296:0:15306:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff996b73aa3800 00000020:01000000:2.0:1787388148.233409:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787388148.233416:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388148.233422:0:15306:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787388148.233434:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff996b450e0000) has no exports 00000100:00100000:3.0:1787388148.233756:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff996b72b47600:6520] 0 exiting: rc = 1 00000100:00100000:1.0:1787388148.233969:0:13515:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff996a41ee1800:13515] 4 exiting: rc = 0 00000100:00100000:1.0:1787388148.234065:0:10197:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff996a42d9da00:10197] 3 exiting: rc = 0 00000100:00100000:1.0:1787388148.234141:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff996b522e9400:6522] 2 exiting: rc = 0 00000100:00100000:3.0:1787388148.236431:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff996b72b46a00:6521] 1 exiting: rc = 0 00000100:00100000:2.0:1787388148.236585:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236594:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236599:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236605:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236611:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236617:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236623:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236628:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236644:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236650:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236655:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236660:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236666:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236671:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236676:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236682:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236687:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236692:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236697:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236702:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236707:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236712:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236716:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236721:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236727:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236732:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236737:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236741:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236748:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236753:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236757:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236763:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236768:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236773:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236788:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236793:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236798:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236811:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236817:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236822:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236828:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236834:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236840:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236845:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236850:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236855:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236859:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236864:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236869:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236874:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236879:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236883:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236888:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236893:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236898:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236903:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236909:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236914:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236918:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236923:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236927:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236932:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236936:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.236942:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.240159:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff996b4617ec00:6523] 0 exiting: rc = 1 00000100:00100000:0.0:1787388148.240244:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff996b4617e200:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1787388148.244244:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.244254:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.244261:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.244267:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.244273:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.244298:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.244305:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.244311:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.244317:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.244323:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.244329:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245332:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245339:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245344:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245371:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245377:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245381:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245386:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245391:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245397:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245401:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245406:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245411:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245416:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245420:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245425:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245430:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245435:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245440:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245445:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245450:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245454:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245459:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245463:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245468:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245473:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245477:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245493:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245499:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245503:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245523:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245528:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245533:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245538:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245543:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245547:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245552:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245557:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245561:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245566:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245570:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245575:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245579:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245584:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245589:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245594:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245598:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245603:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245608:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245612:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245617:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245621:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245626:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.245640:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388148.247426:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff996b4506fa00:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1787388148.247737:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff996b4506f600:6525] 0 exiting: rc = 1 00000100:00100000:0.0:1787388148.248460:0:12997:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff996a43897800:12997] 2 exiting: rc = 0 00000100:00100000:2.0:1787388148.248567:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248587:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248595:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248600:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248605:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248611:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248646:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248654:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248660:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248665:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248671:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248690:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248695:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248701:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248708:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248714:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248720:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248727:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248750:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248757:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248764:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248770:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248777:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248782:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248789:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248795:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248813:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248821:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248827:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248833:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248855:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248863:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248868:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248875:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248882:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248889:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248896:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248903:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248911:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248917:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248924:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248932:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248954:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248963:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248971:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248979:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.248994:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249001:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249009:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249016:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249022:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249608:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249616:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249621:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249655:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249662:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249668:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249674:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249679:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249684:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249689:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249694:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249700:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.249706:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388148.266716:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff996b4506ee00:6528] 1 exiting: rc = 0 00000100:00100000:0.0:1787388148.267182:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff996b4506fe00:6527] 0 exiting: rc = 1 00000100:00100000:2.0:1787388148.267301:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267309:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267314:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267319:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267325:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267330:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267335:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267340:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267373:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267380:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267385:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267390:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267394:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267399:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267404:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267409:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267415:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267433:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267438:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267443:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267447:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267453:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267458:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267462:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267467:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267472:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267477:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267481:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267486:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267491:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267496:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267501:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267506:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267512:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267517:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267522:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267527:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267532:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267537:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267541:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267546:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267551:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267556:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267561:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267566:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267570:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267575:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267580:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267585:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267589:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267594:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267598:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267611:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267616:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267621:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267625:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267640:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267646:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267651:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267655:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267660:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267664:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267669:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.267674:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388148.268715:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff996b4506e800:6530] 1 exiting: rc = 0 00000100:00100000:0.0:1787388148.271829:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff996b4506f800:6529] 0 exiting: rc = 1 00000100:00100000:0.0:1787388148.278529:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278538:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278543:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278548:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278553:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278557:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278562:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278567:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278571:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278576:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278581:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278585:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278589:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278594:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278598:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278603:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278608:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278612:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278616:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278621:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278626:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278640:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278646:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278650:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278654:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278659:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278664:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278669:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278674:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278679:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278684:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278701:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278706:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278711:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278716:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278721:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278725:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278730:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278735:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278740:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278745:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278750:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278755:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278760:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278766:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278772:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278777:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278781:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278786:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278791:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278796:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278813:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278819:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278824:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278830:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278834:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278839:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278843:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278849:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278853:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278857:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278861:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278866:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.278870:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.279416:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff996b4506ec00:6531] 0 exiting: rc = 1 00000100:00100000:3.0:1787388148.279562:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff996b4506ea00:6532] 1 exiting: rc = 0 00000100:00100000:0.0:1787388148.279664:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279670:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279682:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279687:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279693:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279698:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279704:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279710:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279715:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279720:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279725:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279729:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279734:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279739:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279743:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279748:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279753:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279758:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279763:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279768:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279772:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279777:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279782:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279786:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279791:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279796:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279939:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279944:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279948:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279953:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279958:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279963:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279968:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279972:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279977:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279982:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279987:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.279999:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280004:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280009:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280013:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280018:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280023:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280028:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280033:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280037:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280043:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280048:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280052:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280057:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280062:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280066:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280072:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280077:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280082:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280087:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280092:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280096:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280102:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280107:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280112:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280117:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280121:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388148.280126:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.281555:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff996b4615e000:6533] 0 exiting: rc = 1 00000100:00100000:3.0:1787388148.281872:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff996b4615ec00:6534] 1 exiting: rc = 0 00000100:00100000:0.0:1787388148.282102:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff996b4615ea00:6535] 2 exiting: rc = 0 00000100:00100000:2.0:1787388148.282198:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282207:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282215:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282223:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282228:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282234:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282240:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282245:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282253:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282271:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282277:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282283:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282289:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282294:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282300:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282304:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282309:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282315:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282320:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282325:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282330:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282369:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282375:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282381:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282386:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282392:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282398:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282403:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282408:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282413:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282418:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282423:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282428:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282445:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282452:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282457:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282462:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282467:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282473:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282486:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282491:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282497:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282503:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282508:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282514:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282519:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282524:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282529:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282535:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282541:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282546:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282551:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282557:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282562:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282568:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282573:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282584:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282590:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282595:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282600:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282606:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282611:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282616:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388148.282626:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787388148.287038:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388148.287051:0:15306:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787388148.287056:0:15306:0:(genops.c:906:class_export_put()) final put ffff996b44ff3000/MDS_uuid 00000020:00000080:2.0:1787388148.287061:0:15306:0:(genops.c:865:class_export_destroy()) destroying export ffff996b44ff3000/MDS_uuid for MDS 00000020:01000000:2.0:1787388148.287067:0:15306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787388148.287223:0:15306:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787388148.337254:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388149.357796:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787388149.996702:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787388149.996712:0:1345:0:(pinger.c:247:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388149.996715:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787388149.996719:0:1345:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787388149.996722:0:1345:0:(import.c:65:import_set_state_nolock()) ffff996a41f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388149.996730:0:1345:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1787388149.996735:0:1345:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787388149.996742:0:1345:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff996a41f5a800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388149.996776:0:1345:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ad880 x1874211945749120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388149.996830:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787388149.996834:0:1345:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787388149.996843:0:1345:0:(import.c:65:import_set_state_nolock()) ffff996a43026000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388149.996847:0:1345:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1787388149.996850:0:1345:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787388149.996854:0:1345:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff996a43026000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388149.996867:0:1345:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ae680 x1874211945749376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787388149.996893:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1874211945749120:0@lo:38:kworker.0 00000100:00100000:2.0:1787388149.996943:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945749248:0@lo:400:kworker.0 00000400:00000100:1.0:1787388149.996956:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945749120 offset 0 length 520: 4 00000400:00000100:2.0:1787388149.996975:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945749248 offset 0 length 224: 4 00000100:00100000:1.0:1787388149.997003:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1874211945749376:0@lo:38:kworker.0 00000100:00100000:2.0:1787388149.997011:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388149.997019:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945749504:0@lo:400:kworker.0 00000400:00000100:1.0:1787388149.997027:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945749376 offset 0 length 520: 4 00000400:00000100:2.0:1787388149.997045:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945749504 offset 0 length 224: 4 00010000:00010000:1.0:1787388150.381750:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388151.418767:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787388152.090816:0:15507:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787388152.107300:0:15507:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787388152.107691:0:15507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.107706:0:15507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.107712:0:15507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.107719:0:15507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388152.107772:0:15507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787388152.107778:0:15507:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787388152.107806:0:15507:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787388152.107817:0:15507:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b412ad880 x1874211945749120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787388164 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388152.107837:0:15507:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787388152.107843:0:15507:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787388152.107848:0:15507:0:(import.c:65:import_set_state_nolock()) ffff996a41f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787388152.107853:0:15507:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787388152.107857:0:15507:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b412ad880 x1874211945749120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787388164 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388152.107864:0:15507:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787388152.107867:0:15507:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1787388152.107921:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1874211945749120:0@lo:38:kworker.0 00000100:00080000:1.0:1787388152.108882:0:15507:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787388152.108893:0:15507:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b412af800 x1874211945749248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388165 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388152.108928:0:15507:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787388152.108933:0:15507:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787388152.108954:0:15507:0:(import.c:65:import_set_state_nolock()) ffff996a420ca000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787388152.109118:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945749248:0@lo:400:kworker.0 00000100:00100000:0.0:1787388152.109409:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1874211945749632:0@lo:39:umount.0 00000400:00000100:0.0:1787388152.109454:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945749632 offset 0 length 224: 4 00010000:00010000:2.0:1787388152.109610:0:15307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388152.109619:0:15307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388152.109628:0:15307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09c00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388152.109632:0:15307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388152.109643:0:15307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388152.109662:0:15307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388152.109668:0:15307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787388152.109671:0:15307:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787388152.109673:0:15307:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787388152.109688:0:15307:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996b5dcf0000 00010000:00010000:2.0:1787388152.109692:0:15307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388152.109698:0:15307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b74e09c00/0x26817551a447449d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a44744a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388152.109709:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388152.109711:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388152.109713:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388152.429477:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787388153.004485:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388153.004494:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388153.004497:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388153.004500:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787388153.004640:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945749760:0@lo:400:kworker.0 00000400:00000100:3.0:1787388153.004692:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945749760 offset 0 length 224: 4 00010000:00010000:0.0:1787388153.454337:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787388153.583415:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787388153.583425:0:8430:0:(genops.c:906:class_export_put()) final put ffff996b44935800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388153.583665:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b44935800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787388153.583920:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b44930000 for lustre-OST0000 00000001:00100000:1.0:1787388153.588233:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787388153.588242:0:9514:0:(genops.c:906:class_export_put()) final put ffff996a4310c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787388153.588386:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff996a4310c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787388153.588434:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a43109000 for lustre-OST0001 00010000:00010000:0.0:1787388154.476579:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787388155.053952:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787388155.053962:0:1345:0:(pinger.c:247:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388155.053965:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787388155.053968:0:1345:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787388155.054113:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945749888:0@lo:400:kworker.0 00000400:00000100:3.0:1787388155.054165:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945749888 offset 0 length 224: 4 00010000:00010000:1.0:1787388155.500664:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388156.524656:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388157.228483:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388147/real 1787388147] req@ffff996b412af100 x1874211945748864/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787388157 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388157.228516:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b412af100 x1874211945748864/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787388157 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787388157.228536:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5dcf0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388157.228561:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787388157.228565:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:530741c0-7948-4b28-86b1-ece4c1322eb9:3648:1874211945748864:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1787388157.228710:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787388157.228716:0:1345:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787388157.228719:0:1345:0:(import.c:65:import_set_state_nolock()) ffff996b5dcf0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787388157.228723:0:1345:0:(import.c:510:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1787388157.228744:0:1345:0:(import.c:589:import_select_connection()) MGC192.168.203.115@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787388157.228751:0:1345:0:(import.c:624:import_select_connection()) MGC192.168.203.115@tcp: import ffff996b5dcf0000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787388157.228779:0:1345:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f5e0000 x1874211945750016/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787388157.228802:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787388157.228807:0:1345:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388157.228886:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787388157.228904:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945750144:0@lo:400:kworker.0 00000400:00000100:1.0:1787388157.228953:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945750144 offset 0 length 224: 4 00000100:00100000:0.0:1787388157.229060:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:530741c0-7948-4b28-86b1-ece4c1322eb9:3648:1874211945750016:0@lo:250:kworker.0 00000400:00000100:0.0:1787388157.229089:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874211945750016 offset 0 length 520: 4 00010000:00010000:0.0:1787388157.549375:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388158.572664:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388159.601332:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388160.621678:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388161.644458:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787388162.285143:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787388162.285152:0:1345:0:(pinger.c:247:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388162.285154:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787388162.285157:0:1345:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388162.285310:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945750272:0@lo:400:kworker.0 00000400:00000100:1.0:1787388162.285391:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945750272 offset 0 length 224: 4 00000100:00100000:0.0:1787388162.351390:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388152/real 1787388152] req@ffff996a4390a680 x1874211945749632/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787388162 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388162.351421:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996a4390a680 x1874211945749632/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787388162 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787388162.351440:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a420ca000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787388162.351464:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1874211945749632:0@lo:39:umount.0 00000100:00080000:1.0:1787388162.351566:0:15507:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787388162.351570:0:15507:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787388162.351575:0:15507:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787388162.352649:0:15507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.352666:0:15507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.352690:0:15507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.352696:0:15507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.352774:0:15507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388162.352781:0:15507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.352788:0:15507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.352793:0:15507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388162.352798:0:15507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388162.356901:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787388162.356915:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388162.356928:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787388162.356932:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388162.356958:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388162.356966:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388162.356971:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787388162.356974:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1787388162.356988:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996b5dcf0000 00010000:00010000:0.0:1787388162.356991:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388162.356997:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70076200/0x26817551a44744ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a44744b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388162.357014:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388162.357019:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388162.357024:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787388162.357027:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388162.357033:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388162.357039:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388162.357054:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787388162.357056:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787388162.357062:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996b5dcf0000 00010000:00010000:0.0:1787388162.357065:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388162.357071:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388162.357072:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388162.357074:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388162.360709:0:15507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787388162.360723:0:15507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70077200/0x26817551a4474721 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a4474728 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388162.360744:0:15507:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787388162.360752:0:15507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1787388162.360755:0:15507:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787388162.360792:0:15507:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787388162.360797:0:15507:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787388162.360807:0:15507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787388162.360827:0:15507:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787388162.360831:0:15507:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff996b7bdf99c0) has no exports 00000020:00080000:1.0:1787388162.360856:0:15507:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff996b7bdf99c0) has no exports 00000020:01000000:1.0:1787388162.362439:0:15507:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996a432327e0 - data ffff996b6b748870/ffff996b74143000 00000020:01000000:1.0:1787388162.362578:0:15507:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996b73a26300 - data ffff996b6b6b5bd0/ffff996b7d73ec00 00010000:00010000:0.0:1787388162.368911:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787388162.379820:0:15507:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787388162.384982:0:15507:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44741fd 00000020:00000080:0.0:1787388162.384995:0:15507:0:(genops.c:906:class_export_put()) final put ffff996a41c59000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787388162.385021:0:15507:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b74ea1800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787388162.385025:0:15507:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b74ea1800 2 00000020:01000004:0.0:1787388162.385029:0:15507:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff996b74ea1800 from lustre-OST0000 00000020:00000080:3.0:1787388162.385053:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a41c59000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787388162.385055:0:15507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388162.385068:0:15507:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787388162.385071:0:15507:0:(genops.c:906:class_export_put()) final put ffff996a41c5c800/lustre-OST0000_UUID 00000020:00000080:0.0:1787388162.385074:0:15507:0:(genops.c:865:class_export_destroy()) destroying export ffff996a41c5c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787388162.385084:0:15507:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787388162.393892:0:15507:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787388162.393914:0:15507:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787388162.393918:0:15507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388162.393928:0:15507:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787388162.393935:0:15507:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff996a41f5e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787388162.393941:0:15507:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff996b738819c0) has exports, disconnecting them 00000020:00080000:3.0:1787388162.393947:0:15507:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff996a41f5e000), last request at 1787387920 00000020:00000080:3.0:1787388162.393951:0:15507:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474227 00000020:00080000:3.0:1787388162.393968:0:15507:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996a41f5e000): rc 0 00000020:00000080:3.0:1787388162.393973:0:15507:0:(genops.c:906:class_export_put()) final put ffff996a41f5e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787388162.394727:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a41f5e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787388162.394766:0:15507:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787388162.394770:0:15507:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787388162.394774:0:15507:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787388162.394779:0:15507:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787388162.394798:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a41f5a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787388162.394901:0:15507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388162.394909:0:15507:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787388162.394912:0:15507:0:(genops.c:906:class_export_put()) final put ffff996a41f5f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787388162.394916:0:15507:0:(genops.c:865:class_export_destroy()) destroying export ffff996a41f5f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787388162.394920:0:15507:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787388162.394969:0:15507:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787388162.394972:0:15507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388162.394977:0:15507:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787388162.394981:0:15507:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff996a420cc800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787388162.394986:0:15507:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff996a420c0000) has exports, disconnecting them 00000020:00080000:2.0:1787388162.394990:0:15507:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff996a420cc800), last request at 1787387921 00000020:00000080:2.0:1787388162.394993:0:15507:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447423c 00000020:00080000:2.0:1787388162.395004:0:15507:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996a420cc800): rc 0 00000020:00000080:2.0:1787388162.395007:0:15507:0:(genops.c:906:class_export_put()) final put ffff996a420cc800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787388162.395041:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a420cc800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787388162.398644:0:15507:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787388162.398652:0:15507:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787388162.398656:0:15507:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787388162.398662:0:15507:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787388162.398820:0:15507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388162.398829:0:15507:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787388162.398836:0:15507:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b74ea1800 1 00000020:00000080:0.0:1787388162.398842:0:15507:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44741c5 00000020:00000080:0.0:1787388162.398849:0:15507:0:(genops.c:906:class_export_put()) final put ffff996b74cdc000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787388162.398854:0:15507:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787388162.398868:0:15507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388162.398873:0:15507:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787388162.398877:0:15507:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff996b7bdfcd40) has no exports 00000020:00000080:0.0:1787388162.401117:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a420ca000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787388162.401129:0:1345:0:(genops.c:906:class_export_put()) final put ffff996a41f5c000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1787388162.401133:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a41f5c000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1787388162.401138:0:1345:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1787388162.401202:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b74cdc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787388162.434686:0:15507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388162.434700:0:15507:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787388162.434716:0:15507:0:(genops.c:906:class_export_put()) final put ffff996b74ea3000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787388162.434722:0:15507:0:(genops.c:865:class_export_destroy()) destroying export ffff996b74ea3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787388162.434733:0:15507:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787388162.434846:0:15507:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff996b74ea4000 00000020:02000400:0.0:1787388162.434898:0:15507:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787388162.670834:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388163.693543:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388164.396417:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388149/real 1787388149] req@ffff996b412ae680 x1874211945749376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787388164 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388164.396445:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b412ae680 x1874211945749376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787388164 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787388164.396464:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a43026000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388164.396479:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787388164.396483:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1874211945749376:0@lo:38:kworker.0 00000100:00080000:3.0:1787388164.397607:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787388164.397614:0:1345:0:(pinger.c:247:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388164.397616:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787388164.397620:0:1345:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787388164.397623:0:1345:0:(import.c:65:import_set_state_nolock()) ffff996a43026000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388164.397629:0:1345:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 471 00000100:00080000:3.0:1787388164.397634:0:1345:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787388164.397640:0:1345:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff996a43026000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388164.397673:0:1345:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ad880 x1874211945750400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787388164.397753:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945750528:0@lo:400:kworker.0 00000400:00000100:3.0:1787388164.397796:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945750528 offset 0 length 224: 4 00000100:00100000:0.0:1787388164.398059:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1874211945750400:0@lo:38:kworker.0 00000400:00000100:0.0:1787388164.398081:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945750400 offset 0 length 520: 4 00010000:00010000:0.0:1787388164.716624:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787388165.165902:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388149/real 1787388149] req@ffff996b412ac000 x1874211945749504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787388165 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388165.212923:0:3651:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff996b412ac000 x1874211945749504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787388165 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787388165.212962:0:3651:0:(import.c:65:import_set_state_nolock()) ffff996a42d85800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787388165.212967:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787388165.235631:0:3651:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1787388165.235702:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388165.235713:0:1345:0:(pinger.c:247:ptlrpc_pinger_process_import()) 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388165.235716:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388165.235720:0:1345:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388165.235723:0:1345:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787388165.235726:0:1345:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787388165.235731:0:1345:0:(import.c:65:import_set_state_nolock()) ffff996a42d85800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388165.235739:0:1345:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 265 00000100:00080000:1.0:1787388165.235759:0:1345:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff996a42d85800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1787388165.235795:0:1345:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996a4390a300 x1874211945750656/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787388165.235870:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1874211945750656:0@lo:38:kworker.0 00000400:00000100:1.0:1787388165.235926:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874211945750656 offset 0 length 520: 4 00000100:00100000:3.0:1787388165.235938:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945749504:0@lo:400:kworker.0 00010000:00010000:1.0:1787388165.741247:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787388165.989593:0:15709:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787388166.005640:0:15709:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787388166.005719:0:15709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.005733:0:15709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.005742:0:15709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.005749:0:15709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.005775:0:15709:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787388166.005780:0:15709:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787388166.005802:0:15709:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787388166.005822:0:15709:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b412ad880 x1874211945750400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787388184 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388166.005902:0:15709:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787388166.005908:0:15709:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787388166.005914:0:15709:0:(import.c:65:import_set_state_nolock()) ffff996a43026000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787388166.005918:0:15709:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787388166.005935:0:15709:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b412ad880 x1874211945750400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787388184 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388166.005943:0:15709:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787388166.005946:0:15709:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:1.0:1787388166.008000:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388166.008015:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.008026:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4c00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787388166.008046:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.008057:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388166.008065:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388166.008072:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787388166.008075:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787388166.008078:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787388166.008094:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996b5dcf0000 00010000:00010000:1.0:1787388166.008098:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.008104:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a431e4c00/0x26817551a4474481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a4474488 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.008128:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388166.008130:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388166.008131:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388166.008167:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1874211945750400:0@lo:38:kworker.0 00000100:00080000:3.0:1787388166.009718:0:15709:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787388166.009732:0:15709:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996a4390b480 x1874211945749760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388169 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388166.009756:0:15709:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b7f5e1c00 x1874211945749888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388171 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388166.009776:0:15709:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b7f5e3100 x1874211945750144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388173 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388166.009791:0:15709:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b412af800 x1874211945750272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388166.009799:0:15709:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b412ace00 x1874211945750528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388180 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388166.009807:0:15709:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996a4390a300 x1874211945750656/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787388175 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388166.009817:0:15709:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787388166.009822:0:15709:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787388166.009827:0:15709:0:(import.c:65:import_set_state_nolock()) ffff996a42d85800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787388166.009959:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945750528:0@lo:400:kworker.0 00000100:00100000:1.0:1787388166.009967:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1874211945749760:0@lo:400:kworker.0 00000100:00100000:1.0:1787388166.009996:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1874211945750656:0@lo:38:kworker.0 00000100:00100000:2.0:1787388166.010230:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945750272:0@lo:400:kworker.0 00000100:00100000:2.0:1787388166.010237:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945750144:0@lo:400:kworker.0 00000100:00080000:3.0:1787388166.010565:0:15709:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787388166.010571:0:15709:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b7f5e1c00 x1874211945749888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388171 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388166.010579:0:15709:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787388166.010583:0:15709:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:0.0:1787388166.011181:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945749888:0@lo:400:kworker.0 00010000:00010000:3.0:1787388166.015089:0:15709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.015225:0:15709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.015233:0:15709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.015239:0:15709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.015253:0:15709:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388166.015260:0:15709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.015266:0:15709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.015272:0:15709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.015278:0:15709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388166.015328:0:15709:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787388166.015332:0:15709:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787388166.015382:0:15709:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787388166.015386:0:15709:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787388166.015390:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388166.015396:0:15709:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787388166.015399:0:15709:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff996a42db19c0) has no exports 00000020:00080000:3.0:1787388166.015425:0:15709:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff996a42db19c0) has no exports 00010000:00010000:1.0:1787388166.021589:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787388166.021604:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.021632:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b414a3e00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787388166.021636:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.021645:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388166.021651:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388166.021656:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787388166.021659:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787388166.021661:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787388166.021676:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996b5dcf0000 00010000:00010000:1.0:1787388166.021680:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.021686:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b414a3e00/0x26817551a447448f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a4474496 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.021700:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388166.021704:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.021709:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4000 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:1.0:1787388166.021712:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.021719:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787388166.021732:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388166.021736:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787388166.021738:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787388166.021740:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787388166.021746:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996b5dcf0000 00010000:00010000:1.0:1787388166.021748:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.021753:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a431e4000/0x26817551a4474713 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a447471a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388166.021768:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388166.021769:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388166.021771:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787388166.023733:0:15709:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996a43232540 - data ffff996b6b5a30d8/ffff996b74dafc00 00000020:01000000:2.0:1787388166.023896:0:15709:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996b7ac79b40 - data ffff996a41846d80/ffff996a4321e800 00010000:00010000:0.0:1787388166.036007:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787388166.052112:0:15709:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787388166.060264:0:15709:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474323 00000020:00000080:0.0:1787388166.060275:0:15709:0:(genops.c:906:class_export_put()) final put ffff996a41c5b800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787388166.060298:0:15709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b7f53f000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787388166.060301:0:15709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b7f53f000 2 00000020:01000004:0.0:1787388166.060303:0:15709:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff996b7f53f000 from lustre-OST0001 00000020:00000080:0.0:1787388166.060333:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388166.060342:0:15709:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787388166.060374:0:15709:0:(genops.c:906:class_export_put()) final put ffff996a420ce000/lustre-OST0001_UUID 00000020:00000080:0.0:1787388166.060377:0:15709:0:(genops.c:865:class_export_destroy()) destroying export ffff996a420ce000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787388166.060384:0:15709:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787388166.060534:0:15709:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 530741c0-7948-4b28-86b1-ece4c1322eb9->MGS 00010000:00010000:0.0:1787388166.060548:0:15709:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70076000/0x26817551a447407c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a4474083 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388166.060560:0:15709:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70076000/0x26817551a447407c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a4474083 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388166.060566:0:15709:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787388166.060568:0:15709:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787388166.060571:0:15709:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787388166.060591:0:15709:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996b5dcf0000 00010000:00010000:0.0:1787388166.060596:0:15709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70076000/0x26817551a447407c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a4474083 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388166.060611:0:15709:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b70076e00/0x26817551a44744f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26817551a44744f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388166.060617:0:15709:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b70076e00/0x26817551a44744f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26817551a44744f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388166.060634:0:15709:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787388166.060636:0:15709:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787388166.060637:0:15709:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787388166.060649:0:15709:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996b5dcf0000 00010000:00010000:0.0:1787388166.060651:0:15709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b70076e00/0x26817551a44744f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26817551a44744f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787388166.060666:0:15709:0:(import.c:65:import_set_state_nolock()) ffff996b5dcf0000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787388166.060670:0:15709:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787388166.060672:0:15709:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787388166.060674:0:15709:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787388166.060677:0:15709:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787388166.060688:0:15709:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff996b7f5e0000 x1874211945750016/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787388172 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787388166.060706:0:15709:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787388166.060709:0:15709:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:3.0:1787388166.060781:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a41c5b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1787388166.060953:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:530741c0-7948-4b28-86b1-ece4c1322eb9:3648:1874211945750016:0@lo:250:kworker.0 10000000:01000000:3.0:1787388166.061021:0:15709:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787388166.061028:0:15709:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4473f79 00000020:00000080:3.0:1787388166.061032:0:15709:0:(genops.c:906:class_export_put()) final put ffff996b44ff6000/530741c0-7948-4b28-86b1-ece4c1322eb9 00000020:01000000:3.0:1787388166.061046:0:15709:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.115@tcp (flags='') 00000020:00000080:3.0:1787388166.061051:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388166.061056:0:15709:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.115@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787388166.061059:0:15709:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff996b72b819c0) has no exports 10000000:01000000:3.0:1787388166.061075:0:6518:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787388166.061116:0:15709:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.115@tcp: client import never connected 00000100:00080000:3.0:1787388166.061119:0:15709:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787388166.061121:0:15709:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787388166.061122:0:15709:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787388166.061124:0:15709:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787388166.061152:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388166.061156:0:15709:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.115@tcp (uuid 530741c0-7948-4b28-86b1-ece4c1322eb9) 00000020:01000000:3.0:1787388166.061162:0:15709:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787388166.061165:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388166.061168:0:15709:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787388166.061172:0:15709:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff996b74f95800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787388166.061177:0:15709:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff996a42db3380) has exports, disconnecting them 00000020:00080000:3.0:1787388166.061181:0:15709:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff996b74f95800), last request at 1787387943 00000020:00000080:3.0:1787388166.061185:0:15709:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a447434d 00000020:00080000:3.0:1787388166.061195:0:15709:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996b74f95800): rc 0 00000020:00000080:3.0:1787388166.061198:0:15709:0:(genops.c:906:class_export_put()) final put ffff996b74f95800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787388166.061936:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b44ff6000/530741c0-7948-4b28-86b1-ece4c1322eb9 for MGC192.168.203.115@tcp 00000020:00000080:2.0:1787388166.061951:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996b5dcf0000 for MGC192.168.203.115@tcp 00000020:00000080:2.0:1787388166.061956:0:1345:0:(genops.c:906:class_export_put()) final put ffff996b5dcf5000/530741c0-7948-4b28-86b1-ece4c1322eb9 00000020:00000080:2.0:1787388166.061958:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b5dcf5000/530741c0-7948-4b28-86b1-ece4c1322eb9 for MGC192.168.203.115@tcp 00000020:01000000:2.0:1787388166.061962:0:1345:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.115@tcp (530741c0-7948-4b28-86b1-ece4c1322eb9) 00000020:00000080:2.0:1787388166.062203:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b74f95800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787388166.070682:0:15709:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787388166.070691:0:15709:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787388166.070695:0:15709:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787388166.070702:0:15709:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787388166.070752:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a43026000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787388166.070886:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787388166.070895:0:15709:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787388166.070900:0:15709:0:(genops.c:906:class_export_put()) final put ffff996a420cb000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787388166.070903:0:15709:0:(genops.c:865:class_export_destroy()) destroying export ffff996a420cb000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787388166.070909:0:15709:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787388166.071633:0:15709:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787388166.071642:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787388166.071649:0:15709:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787388166.071656:0:15709:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff996a42d80000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787388166.071663:0:15709:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff996b739c99c0) has exports, disconnecting them 00000020:00080000:2.0:1787388166.071676:0:15709:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff996a42d80000), last request at 1787387943 00000020:00000080:2.0:1787388166.071681:0:15709:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a4474362 00000020:00080000:2.0:1787388166.071693:0:15709:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff996a42d80000): rc 0 00000020:00000080:2.0:1787388166.071699:0:15709:0:(genops.c:906:class_export_put()) final put ffff996a42d80000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1787388166.072760:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42d80000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1787388166.100605:0:15709:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787388166.100616:0:15709:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787388166.100620:0:15709:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787388166.100627:0:15709:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787388166.100662:0:1345:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996a42d85800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1787388166.100723:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787388166.100873:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787388166.100984:0:15307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787388166.101094:0:10397:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff996a41088400:10397] 2 exiting: rc = 0 00000100:00100000:0.0:1787388166.101251:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff996b5ed81e00:6504] 0 exiting: rc = 1 00000100:00100000:3.0:1787388166.121461:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff996b5ed81200:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1787388166.121567:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.121822:0:7462:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff996b73ac0a00:7462] 3 exiting: rc = 0 00000100:00100000:3.0:1787388166.121969:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff996b5ed80a00:6507] 1 exiting: rc = 0 00000100:00100000:3.0:1787388166.122026:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff996b5ed29c00:6508] 2 exiting: rc = 0 00000100:00100000:3.0:1787388166.122567:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff996b5ed28200:6506] 0 exiting: rc = 1 00000100:00100000:0.0:1787388166.122662:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122670:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122676:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122682:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122689:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122694:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122700:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122705:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122712:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122718:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122724:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122729:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122735:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122741:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122748:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122754:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122760:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122765:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122771:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122777:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122783:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122788:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122793:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122798:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122803:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122808:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122815:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122821:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122826:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122832:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122837:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122843:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122848:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122853:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122868:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122874:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122879:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122885:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122890:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122896:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122902:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122908:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122914:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122920:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122925:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122930:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122936:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122941:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122947:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122952:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122958:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122963:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122967:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122972:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122977:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122982:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122987:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122993:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.122998:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.123003:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.123009:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.123014:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.123020:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.123025:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787388166.123847:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787388166.123857:0:15709:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787388166.123862:0:15709:0:(genops.c:906:class_export_put()) final put ffff996a42d83000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787388166.123867:0:15709:0:(genops.c:865:class_export_destroy()) destroying export ffff996a42d83000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787388166.123876:0:15709:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787388166.123927:0:15709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b7f53f000 1 00000020:00000080:0.0:1787388166.123932:0:15709:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26817551a44742f2 00000020:00000080:0.0:1787388166.123938:0:15709:0:(genops.c:906:class_export_put()) final put ffff996b7bdbe800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787388166.123989:0:15709:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787388166.123994:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787388166.123999:0:15709:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787388166.124002:0:15709:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff996a420c19c0) has no exports 00000020:00000080:3.0:1787388166.126494:0:1345:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7bdbe800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787388166.152593:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388166.152608:0:15709:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787388166.152614:0:15709:0:(genops.c:906:class_export_put()) final put ffff996b7f53a800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787388166.152619:0:15709:0:(genops.c:865:class_export_destroy()) destroying export ffff996b7f53a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787388166.152625:0:15709:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787388166.153251:0:15709:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff996b7f53f800 00000020:01000000:3.0:1787388166.153539:0:15709:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787388166.153584:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787388166.153590:0:15709:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787388166.153594:0:15709:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff996b73884d40) has no exports 00000020:00000080:3.0:1787388166.153615:0:15709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787388166.153621:0:15709:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787388166.153624:0:15709:0:(genops.c:906:class_export_put()) final put ffff996b74cdf000/OSS_uuid 00000020:00000080:3.0:1787388166.153627:0:15709:0:(genops.c:865:class_export_destroy()) destroying export ffff996b74cdf000/OSS_uuid for OSS 00000020:01000000:3.0:1787388166.153631:0:15709:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787388166.153807:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff996b73990600:8434] 0 exiting: rc = 1 00000100:00080000:0.0:1787388166.153955:0:6517:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787388166.154063:0:8490:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff996a41f05400:8490] 3 exiting: rc = 0 00000100:00100000:1.0:1787388166.154068:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff996b44965200:8437] 2 exiting: rc = 0 00000100:00100000:1.0:1787388166.154264:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff996b58396a00:8436] 1 exiting: rc = 0 00000100:00100000:3.0:1787388166.154565:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154574:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154583:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154591:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154598:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154603:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154607:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154611:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154615:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154620:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154625:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154630:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154635:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154641:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154646:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154652:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154669:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154674:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154679:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154685:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154690:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154695:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154701:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154705:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154714:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154723:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154728:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154734:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154738:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154744:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154749:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154754:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154759:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154764:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154770:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154775:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154780:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154785:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154790:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154795:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154801:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154807:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154819:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154827:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154903:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154910:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154916:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154921:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154925:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154930:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154936:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154948:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154953:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154959:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154970:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154976:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154981:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154987:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154992:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.154998:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.155002:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.155007:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.155013:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.155018:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.156652:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff996b74d08000:8439] 1 exiting: rc = 0 00000100:00100000:2.0:1787388166.156733:0:10098:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff996a42fb4000:10098] 2 exiting: rc = 0 00000100:00100000:0.0:1787388166.156909:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff996b73a3b800:8438] 0 exiting: rc = 1 00000100:00100000:3.0:1787388166.157022:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157039:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157046:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157051:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157055:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157060:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157065:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157070:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157074:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157080:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157085:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157090:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157094:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157100:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157105:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157110:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157115:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157120:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157125:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157130:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157135:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157140:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157156:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157162:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157166:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157171:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157177:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157182:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157187:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157192:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157197:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157202:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157207:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157213:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157217:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157222:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157227:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157232:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157237:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157242:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157247:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157252:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157258:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157264:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157339:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157566:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157578:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157584:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157589:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157593:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157597:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157601:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157606:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157611:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157615:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157619:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157629:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157641:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157646:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157651:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157655:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157660:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157665:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.157670:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787388166.159054:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff996b74ccec00:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1787388166.159240:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff996b74d09c00:8440] 0 exiting: rc = 1 00000100:00100000:0.0:1787388166.159598:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff996b74cb5400:8442] 2 exiting: rc = 0 00000100:00100000:2.0:1787388166.159710:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159717:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159723:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159730:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159736:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159741:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159747:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159752:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159758:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159763:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159769:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159774:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159780:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159785:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159791:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159797:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159802:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159807:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159812:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159817:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159822:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159827:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159909:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159915:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159920:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159925:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159943:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159962:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159969:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159974:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159980:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159985:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159990:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.159996:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160001:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160006:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160012:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160019:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160024:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160029:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160035:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160042:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160047:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160053:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160058:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160063:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160068:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160074:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160079:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160085:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160091:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160110:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160117:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160124:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160129:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160134:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160139:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160145:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160150:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160156:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160161:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160174:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160186:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.160193:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787388166.174639:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff996b7bff6a00:8444] 1 exiting: rc = 0 00000100:00100000:1.0:1787388166.174910:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff996b7bff6c00:8443] 0 exiting: rc = 1 00000100:00100000:2.0:1787388166.175112:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175119:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175125:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175131:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175136:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175141:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175146:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175152:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175157:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175162:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175168:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175172:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175178:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175182:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175187:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175192:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175197:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175202:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175206:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175211:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175215:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175220:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175224:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175230:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175235:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175240:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175245:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175250:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175254:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175259:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175263:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175268:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175603:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175612:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175617:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175621:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175626:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175632:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175637:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175642:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175647:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175652:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175657:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175661:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175666:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175670:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175675:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175679:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175684:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175689:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175693:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175697:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175702:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175707:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175711:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175717:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175722:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175726:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175731:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175736:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175741:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175745:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175750:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.175755:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787388166.177488:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff996b7bff3a00:8445] 0 exiting: rc = 1 00000100:00100000:3.0:1787388166.177660:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff996b623f7c00:8446] 1 exiting: rc = 0 00000100:00100000:2.0:1787388166.177786:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177797:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177802:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177822:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177899:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177908:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177913:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177918:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177923:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177928:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177933:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177939:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177959:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177966:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177972:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.177978:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178045:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178055:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178061:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178067:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178073:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178079:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178085:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178091:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178113:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178120:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178125:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178130:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178135:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178141:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178146:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178153:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178160:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178166:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178172:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178178:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178197:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178205:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178216:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178222:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178227:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178233:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178240:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178246:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178253:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178258:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178264:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178333:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178633:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178641:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178647:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178654:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178660:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178666:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178672:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178678:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178685:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178691:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178698:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178703:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178721:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178729:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178735:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787388166.178741:0:15709:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787388166.192714:0:15709:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787388186.692597:0:16473:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787388200.761859:0:17074:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787388200.761866:0:17074:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787388200.761867:0:17074:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787388200.761967:0:17074:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff996a44056800 00000020:01000004:0.0:1787388200.761981:0:17074:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787388200.761989:0:17074:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787388200.762002:0:17074:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff996b72b819c0) 00000020:00000080:0.0:1787388200.762015:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787388200.846951:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787388200.848201:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787388200.849827:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787388200.850243:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787388200.850589:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787388200.850806:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787388200.851087:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787388200.860456:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787388200.863972:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787388200.865112:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787388200.865809:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787388200.866242:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787388200.866703:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787388200.866954:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787388200.876831:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787388200.880622:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.881401:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.881857:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.882074:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.882867:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.883550:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.883841:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.884580:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.884861:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.885063:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.885727:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.886189:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.886667:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.887032:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.887218:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.887628:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.887883:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.888062:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.888233:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.888616:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.888849:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.889081:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.889378:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.890290:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.897620:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.898886:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.899660:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.899942:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787388200.900537:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.901619:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.903641:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.904001:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787388200.904906:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787388200.905366:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787388200.905900:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787388200.906254:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787388200.906708:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1787388200.906895:0:17074:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:0.0:1787388200.907341:0:17074:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787388200.907619:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787388200.907626:0:17074:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787388200.907636:0:17074:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a4475536 00000020:01000004:0.0:1787388200.907641:0:17074:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787388200.907645:0:17074:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787388200.907650:0:17074:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996a44056800 from MGS 00000020:01000004:0.0:1787388200.907659:0:17074:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787388200.907668:0:17074:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff996b72b83380) 00000020:00000080:0.0:1787388200.907678:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787388200.907730:0:17074:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996a44056800 from MGS, refs=2 00080000:01000000:0.0:1787388200.907734:0:17074:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787388200.907738:0:17074:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a4475544 00000100:00100000:0.0:1787388200.907818:0:17074:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787388200.907919:0:17074:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787388200.907924:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787388200.915178:0:17074:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787388200.915190:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787388200.922309:0:17074:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787388200.922525:0:17074:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787388200.922531:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787388200.930262:0:17074:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787388200.930283:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787388200.930686:0:17074:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787388200.930693:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787388200.937021:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388200.937028:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388200.937030:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388200.937661:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388200.937664:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388200.937666:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388200.938203:0:17074:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787388200.939758:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787388200.948908:0:17074:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787388200.949732:0:17086:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787388200.949787:0:17074:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787388200.949819:0:17074:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787388200.950423:0:17074:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787388200.950868:0:17074:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787388200.951003:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787388200.951009:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787388200.952668:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787388200.952679:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787388200.952986:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787388200.952992:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787388200.954305:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787388200.954328:0:17074:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.115@tcp' 00000020:01000004:0.0:1787388200.954330:0:17074:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787388200.954394:0:17074:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.115@tcp (typ=mgc) 00000020:00000080:0.0:1787388200.954406:0:17074:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.115@tcp (ffff996b72b80000) 00000020:00000080:0.0:1787388200.954420:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1787388200.955162:0:17090:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1787388200.956318:0:17074:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996b44ff5000@MGC192.168.203.115@tcp: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1787388200.957264:0:17074:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.115@tcp-0 is initialized 00000040:01000000:0.0:1787388200.957283:0:17074:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787388200.975138:0:17091:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787388200.975230:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.115@tcp (uuid ae525cec-d184-4a5a-bf65-8c20a2a658d5) 00000020:00000080:0.0:1787388200.975255:0:17074:0:(genops.c:1406:class_connect()) connect: client ae525cec-d184-4a5a-bf65-8c20a2a658d5, cookie 0x26817551a4475552 00000100:00080000:0.0:1787388200.975266:0:17074:0:(import.c:510:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787388200.975284:0:17074:0:(import.c:624:import_select_connection()) MGC192.168.203.115@tcp: import ffff996b44ff5000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1787388200.975317:0:17074:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b738ead80 x1874211945750784/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787388200.975396:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3648:1874211945750784:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787388200.975477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388200.975565:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945750784 00000100:00100000:3.0:1787388200.975573:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945750784 00000100:00100000:3.0:1787388200.975604:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787388200.975619:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1874211945750784:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787388200.975641:0:17087:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from ae525cec-d184-4a5a-bf65-8c20a2a658d5@0@lo t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:3.0:1787388200.975664:0:17087:0:(genops.c:1406:class_connect()) connect: client ae525cec-d184-4a5a-bf65-8c20a2a658d5, cookie 0x26817551a4475559 00000100:00080000:3.0:1787388200.975782:0:17087:0:(import.c:65:import_set_state_nolock()) ffff996a43110800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787388200.975909:0:17074:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ae525cec-d184-4a5a-bf65-8c20a2a658d5->MGS 00000020:01000004:0.0:1787388200.975924:0:17074:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787388200.975928:0:17074:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787388200.975941:0:17074:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff996b72b84d40) 00000020:00000080:0.0:1787388200.975951:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787388200.991207:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+5:3648:x1874211945750784:12345-0@lo:250:mount.lustre.0 Request processed in 15578us (15720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388200.991223:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787388200.996627:0:3648:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787388200.996645:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.115@tcp: connect to target with instance 0 00000100:00080000:2.0:1787388200.996654:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787388200.996660:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787388200.996665:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b44ff5000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787388200.996668:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787388200.998609:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787388200.998625:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3648:1874211945750784:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787388200.998818:0:17074:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787388200.998984:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787388200.998991:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787388201.009754:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787388201.009769:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787388201.010231:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787388201.010239:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787388201.011806:0:17074:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787388201.011955:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787388201.011961:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787388201.019702:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787388201.021666:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787388201.073908:0:17074:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787388201.074072:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787388201.074079:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787388201.087227:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787388201.087247:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787388201.092998:0:17074:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787388201.093153:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787388201.093159:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787388201.094091:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787388201.094103:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787388201.094926:0:17074:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787388201.095078:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787388201.095084:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787388201.096019:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787388201.096027:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787388201.099406:0:17074:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787388201.099575:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787388201.099581:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787388201.101960:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787388201.101972:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787388201.132415:0:17074:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787388201.132595:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787388201.132601:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787388201.144421:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787388201.144438:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787388201.154964:0:17074:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787388201.154979:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787388201.161853:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787388201.161959:0:17074:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787388201.161966:0:17074:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787388201.162079:0:17074:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787388201.162138:0:17074:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.115@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787388201.162142:0:17074:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787388201.162143:0:17074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787388201.162145:0:17074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388201.162152:0:17074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388201.162153:0:17074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388201.162154:0:17074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388201.162155:0:17074:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787388201.162156:0:17074:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787388201.162158:0:17074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388201.162159:0:17074:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787388201.162161:0:17074:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787388201.162163:0:17074:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787388201.162164:0:17074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787388201.162165:0:17074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388201.162166:0:17074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388201.162167:0:17074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388201.162168:0:17074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388201.162169:0:17074:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787388201.162170:0:17074:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787388201.162171:0:17074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388201.162171:0:17074:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787388201.162196:0:17074:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787388201.162226:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945750912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787388201.162302:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388201.162388:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a423656c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388201.162690:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945750912 00000100:00100000:3.0:1787388201.162697:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945750912 00000100:00100000:3.0:1787388201.162736:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787388201.162744:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+5:17074:x1874211945750912:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787388201.162791:0:17089:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787388201.162794:0:17089:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787388201.162797:0:17089:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787388201.165875:0:17110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787388201.177393:0:17089:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1787388201.190005:0:17111:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787388201.190013:0:17111:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1787388201.190016:0:17111:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787388201.190018:0:17111:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787388201.190491:0:17111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787388201.194923:0:17089:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787388201.194937:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787388201.204761:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+5:17074:x1874211945750912:12345-0@lo:253:mount.lustre.0 Request processed in 41999us (42440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.204781:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787388201.208799:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945750912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787388201.208818:0:17074:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787388201.208821:0:17074:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787388201.208823:0:17074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787388201.208824:0:17074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388201.208825:0:17074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388201.208826:0:17074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388201.208828:0:17074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388201.208829:0:17074:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787388201.208830:0:17074:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787388201.208832:0:17074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388201.208833:0:17074:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787388201.212957:0:17074:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996a44056800 from lustre-MDT0000 10000000:01000000:2.0:1787388201.213006:0:17074:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787388201.213009:0:17074:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787388201.213014:0:17074:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff996b72b80000 10000000:01000000:2.0:1787388201.213017:0:17074:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787388201.213026:0:17074:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff996b72b80000 from 1 10000000:01000000:2.0:1787388201.213028:0:17074:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787388201.213211:0:17074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388201.213224:0:17074:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388201.213235:0:17074:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388201.213260:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388201.213340:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388201.213724:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42260000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388201.220808:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945751040 00000100:00100000:3.0:1787388201.220822:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945751040 00000100:00100000:3.0:1787388201.220952:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787388201.220965:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+5:17074:x1874211945751040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388201.220980:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388201.221004:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f6400/0x26817551a447556e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475567 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388201.221063:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f6400/0x26817551a447556e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475567 expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388201.221077:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f6400/0x26817551a447556e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475567 expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388201.221086:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6400, rc 0) 00000100:00100000:3.0:1787388201.221168:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+6:17074:x1874211945751040:12345-0@lo:101:mount.lustre.0 Request processed in 206us (7827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388201.221176:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388201.221286:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388201.221305:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.221315:0:17074:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388201.221413:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388201.221463:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.222175:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b460ea240 going to sleep for 11 seconds 00000100:00100000:0.0:1787388201.222259:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945751168 00000100:00100000:0.0:1787388201.222274:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945751168 00000100:00100000:0.0:1787388201.222312:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787388201.222319:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+6:17074:x1874211945751168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388201.222424:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+6:17074:x1874211945751168:12345-0@lo:501:mount.lustre.0 Request processed in 105us (975us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787388201.222431:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787388201.222549:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751168:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787388201.222581:0:17074:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787388201.222602:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.222618:0:17074:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388201.222627:0:17074:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996a44056800 10000000:01000000:1.0:1787388201.222631:0:17074:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787388201.222636:0:17074:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff996a44056800 10000000:01000000:1.0:1787388201.222638:0:17074:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787388201.222647:0:17074:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff996a44056800 from 1 10000000:01000000:1.0:1787388201.222649:0:17074:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787388201.222673:0:17074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4ee00/0x26817551a4475575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.222682:0:17074:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4ee00/0x26817551a4475575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.222690:0:17074:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4ee00/0x26817551a4475575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388201.222705:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388201.222735:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.222768:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945751296 00000100:00100000:1.0:1787388201.222773:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945751296 00000100:00100000:1.0:1787388201.222791:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787388201.222796:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+6:17074:x1874211945751296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388201.222803:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388201.222814:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f4fc00/0x26817551a447557c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475575 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.222827:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f4fc00/0x26817551a447557c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475575 expref: 7 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.222836:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f4fc00/0x26817551a447557c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475575 expref: 7 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.222843:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fc00, rc 0) 00000100:00100000:1.0:1787388201.222863:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+7:17074:x1874211945751296:12345-0@lo:101:mount.lustre.0 Request processed in 67us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.222878:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787388201.222906:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b460ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1787388201.222917:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388201.222926:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4ee00/0x26817551a4475575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447557c expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.222933:0:17074:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4ee00/0x26817551a4475575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447557c expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388201.222943:0:17074:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787388201.222947:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4ee00/0x26817551a4475575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447557c expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.222953:0:17074:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4ee00/0x26817551a4475575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447557c expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388201.222958:0:17074:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787388201.222961:0:17074:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787388201.222965:0:17074:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff996a44056800 10000000:01000000:1.0:1787388201.222967:0:17074:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787388201.222970:0:17074:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787388201.222972:0:17074:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787388201.222983:0:17074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4e400/0x26817551a4475583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.222989:0:17074:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4e400/0x26817551a4475583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.222996:0:17074:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4e400/0x26817551a4475583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388201.223012:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388201.223034:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.223064:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945751424 00000100:00100000:1.0:1787388201.223068:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945751424 00000100:00100000:1.0:1787388201.223082:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388201.223088:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+7:17074:x1874211945751424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388201.223094:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388201.223100:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f4fe00/0x26817551a447558a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475583 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.223112:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f4fe00/0x26817551a447558a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475583 expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.223120:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f4fe00/0x26817551a447558a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475583 expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.223126:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fe00, rc 0) 00000100:00100000:1.0:1787388201.223148:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+8:17074:x1874211945751424:12345-0@lo:101:mount.lustre.0 Request processed in 60us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.223154:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388201.223172:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b43346c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388201.223182:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388201.223191:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4e400/0x26817551a4475583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447558a expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.223198:0:17074:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4e400/0x26817551a4475583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447558a expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388201.223242:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388201.223262:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.223293:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945751552 00000100:00100000:1.0:1787388201.223296:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945751552 00000100:00100000:1.0:1787388201.223310:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787388201.223315:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+8:17074:x1874211945751552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388201.223432:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+9:17074:x1874211945751552:12345-0@lo:501:mount.lustre.0 Request processed in 116us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.223439:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787388201.223482:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b43346c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388201.223493:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388201.223515:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388201.223549:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.223565:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945751680 00000100:00100000:1.0:1787388201.223568:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945751680 00000100:00100000:1.0:1787388201.223583:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787388201.223588:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+9:17074:x1874211945751680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388201.223736:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea000 going to sleep for 11 seconds 00000100:00100000:1.0:1787388201.228677:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+9:17074:x1874211945751680:12345-0@lo:503:mount.lustre.0 Request processed in 5079us (5118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.228693:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787388201.228886:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945751680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388201.230283:0:17112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17112:1874211945751808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388201.230385:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388201.230424:0:17112:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365780 going to sleep for 11 seconds 00000100:00100000:1.0:1787388201.230545:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945751808 00000100:00100000:1.0:1787388201.230552:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945751808 00000100:00100000:1.0:1787388201.230596:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787388201.230605:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+9:17112:x1874211945751808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388201.233065:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+9:17112:x1874211945751808:12345-0@lo:502:llog_process_th.0 Request processed in 2452us (2672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388201.233078:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787388201.233399:0:17112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17112:1874211945751808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787388201.233435:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388201.233459:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388201.233461:0:17112:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787388201.233467:0:17112:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787388201.233470:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388201.233483:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff996a42db0000) 00000020:00000080:1.0:1787388201.233499:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787388201.233504:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787388201.233587:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787388201.233594:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a4475598 00000020:00000080:1.0:1787388201.233966:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787388201.233971:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388201.233976:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388201.233977:0:17112:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787388201.233980:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388201.233983:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388201.233984:0:17112:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787388201.233987:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388201.233994:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff996a42db4d40) 00000020:00000080:1.0:1787388201.234004:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787388201.234009:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787388201.234010:0:17112:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787388201.234013:0:17112:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787388201.234018:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787388201.234129:0:17112:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996a44056800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787388201.234142:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff996a42db3380) 00000020:00000080:1.0:1787388201.234149:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787388201.234205:0:17112:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787388201.234212:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a44755ad 00000020:00000080:1.0:1787388201.234308:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787388201.234319:0:17112:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787388201.234324:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x26817551a44755b4 00080000:01000000:1.0:1787388201.234329:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787388201.234333:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a44755bb 00010000:00010000:2.0:1787388201.354343:0:17112:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787388201.358448:0:17112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1787388201.359109:0:17112:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787388201.359555:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff996a433899c0) 00000020:00000080:2.0:1787388201.359572:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787388201.359647:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787388201.359655:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a44755c9 00000020:00000080:2.0:1787388201.363165:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787388201.383406:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x26817551a44755d0 00000020:00000080:2.0:1787388201.385125:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787388201.385139:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388201.385147:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388201.385149:0:17112:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787388201.385154:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787388201.385169:0:17112:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787388201.385171:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787388201.385172:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787388201.385175:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787388201.385177:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388201.385179:0:17112:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787388201.385182:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388201.385187:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388201.385188:0:17112:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787388201.385193:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787388201.385236:0:17112:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787388201.385251:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388201.385254:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388201.385255:0:17112:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787388201.385258:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388201.385261:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388201.385262:0:17112:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787388201.385275:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787388201.385281:0:17112:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:00000080:2.0:1787388201.385307:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787388201.385321:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff996a4338b380) 00000020:00000080:2.0:1787388201.385336:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787388201.385341:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787388201.385594:0:17112:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787388201.385600:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787388201.385608:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a44755de 00010000:00080000:2.0:1787388201.385636:0:17112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996b5ddf4800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1787388201.390472:0:17112:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787388201.392707:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787388201.392723:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787388201.393010:0:17112:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787388201.393035:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a44755e5 00000100:00080000:2.0:1787388201.393120:0:17112:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787388201.393139:0:17112:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff996b5ddf4800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787388201.393179:0:17112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f5e0000 x1874211945751936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787388201.393261:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945751936:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787388201.393388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388201.393603:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945751936 00000100:00100000:0.0:1787388201.393611:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945751936 00000100:00100000:0.0:1787388201.393653:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388201.393661:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1874211945751936:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1787388201.393676:0:17099:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1787388201.395515:0:17112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787388201.395636:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388201.395642:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388201.395644:0:17112:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787388201.395648:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787388201.395650:0:17112:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1787388201.395652:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787388201.395653:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787388201.395654:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787388201.395657:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388201.395658:0:17112:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787388201.395661:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787388201.395665:0:17112:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787388201.395669:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388201.395671:0:17112:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787388201.395673:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787388201.395677:0:17112:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:2.0:1787388201.395703:0:17112:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787388201.395706:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787388201.395721:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff996a43388000) 00000020:00000080:2.0:1787388201.395740:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787388201.395759:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787388201.396900:0:17112:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787388201.396908:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787388201.396917:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a44755f3 00010000:00080000:2.0:1787388201.396953:0:17112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996b5ddfe000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1787388201.397336:0:17112:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787388201.404165:0:17112:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787388201.404397:0:17112:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787388201.406159:0:17112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787388201.412729:0:17112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787388201.420989:0:17112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787388201.421453:0:17118:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787388201.421458:0:17118:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1787388201.427232:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1874211945751936:12345-0@lo:38:llog_process_th.0 Request processed in 33565us (33839us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787388201.427247:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787388201.427317:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388201.427323:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787388201.427327:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945751936:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1787388201.440665:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787388201.440680:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787388201.440726:0:17112:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787388201.440746:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a44755fa 00000100:00080000:1.0:1787388201.440756:0:17112:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787388201.440762:0:17112:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff996b5ddfe000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1787388201.440797:0:17112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996a43908a80 x1874211945752064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388201.440813:0:17112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787388201.440874:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388201.440877:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388201.440879:0:17112:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787388201.440882:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787388201.440885:0:17112:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1787388201.440887:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388201.440888:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388201.440890:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787388201.440892:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388201.440894:0:17112:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787388201.440896:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787388201.440900:0:17112:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787388201.440902:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388201.440903:0:17112:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787388201.440906:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787388201.440910:0:17112:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:1.0:1787388201.440942:0:17112:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787388201.440945:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388201.440955:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff996a42db19c0) 00000020:00000080:1.0:1787388201.440967:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787388201.440971:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787388201.441036:0:17112:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787388201.441042:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787388201.441047:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26817551a4475608 00010000:00080000:1.0:1787388201.441074:0:17112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a42fcb800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:1.0:1787388201.441256:0:17112:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787388201.441330:0:17112:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787388201.441344:0:17112:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787388201.443952:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945752064:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787388201.444014:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211945752064 offset 0 length 520: 4 00000040:00080000:3.0:1787388201.451831:0:17112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787388201.452292:0:17112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787388201.452586:0:17112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787388201.460002:0:17120:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787388201.460012:0:17120:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787388201.474195:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787388201.474212:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787388201.477013:0:17112:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787388201.477045:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a447560f 00000100:00080000:3.0:1787388201.477056:0:17112:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787388201.477063:0:17112:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff996a42fcb800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388201.477099:0:17112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ae300 x1874211945752192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388201.477133:0:17112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787388201.477302:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388201.477310:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388201.477312:0:17112:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787388201.477316:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1787388201.477319:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945752192:0@lo:8:llog_process_th.0 00000020:00000080:3.0:1787388201.477321:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388201.477325:0:17112:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787388201.477329:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787388201.477331:0:17112:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787388201.477333:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388201.477336:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388201.477337:0:17112:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787388201.477340:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388201.477344:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388201.477375:0:17112:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787388201.477382:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000400:00000100:1.0:1787388201.477399:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211945752192 offset 0 length 520: 4 00000100:00100000:3.0:1787388201.477420:0:17112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17112:1874211945752320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388201.477482:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388201.477513:0:17112:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787388201.477557:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945752320 00000100:00100000:1.0:1787388201.477564:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945752320 00000100:00100000:1.0:1787388201.477605:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787388201.477613:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+9:17112:x1874211945752320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388201.477729:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+9:17112:x1874211945752320:12345-0@lo:502:llog_process_th.0 Request processed in 117us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.477738:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787388201.477769:0:17112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17112:1874211945752320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787388201.477798:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388201.477809:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388201.477811:0:17112:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787388201.477818:0:17112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787388201.477962:0:17074:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1787388201.477986:0:17074:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787388201.478004:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4e400/0x26817551a4475583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447558a expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.478025:0:17074:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4e400/0x26817551a4475583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447558a expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388201.478032:0:17074:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996a44056800 from 1 10000000:01000000:1.0:1787388201.478035:0:17074:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787388201.478062:0:17074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.478070:0:17074:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.478079:0:17074:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388201.478094:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945752448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388201.478125:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.478146:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388201.478214:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945752448 00000100:00100000:3.0:1787388201.478219:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945752448 00000100:00100000:0.0:1787388201.481573:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787388201.481595:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b58389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+9:17074:x1874211945752448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388201.481613:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388201.481743:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b40031e00/0x26817551a447561d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475616 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.481771:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40031e00/0x26817551a447561d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475616 expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.481781:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b40031e00/0x26817551a447561d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475616 expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.481789:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031e00, rc 0) 00000100:00100000:0.0:1787388201.481993:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b58389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+10:17074:x1874211945752448:12345-0@lo:101:mount.lustre.0 Request processed in 407us (3866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388201.482000:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787388201.482076:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945752448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388201.482093:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388201.482113:0:17074:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388201.483025:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945752576:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787388201.483077:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388201.485049:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5dc4b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787388201.490540:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945752576 00000100:00100000:1.0:1787388201.490556:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945752576 00000100:00100000:1.0:1787388201.490628:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388201.490638:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+10:17074:x1874211945752576:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787388201.490662:0:17087:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787388201.490668:0:17087:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787388201.490974:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+10:17074:x1874211945752576:12345-0@lo:256:mount.lustre.0 Request processed in 336us (7894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.490983:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787388201.491033:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787388201.491055:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787388201.491058:0:36:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388201.491064:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 522 00000100:00080000:1.0:1787388201.491070:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787388201.491076:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff996b5ddf4800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1787388201.491109:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996a43908000 x1874211945752704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388201.491132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388201.491136:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388201.491140:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388201.491143:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388201.491172:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945752704:0@lo:38:kworker.0 00000100:00100000:1.0:1787388201.491216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.491276:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945752704 00000100:00100000:1.0:1787388201.491280:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945752704 00000100:00100000:1.0:1787388201.491303:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787388201.491307:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1874211945752704:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787388201.491322:0:17100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787388201.491373:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1874211945752704:12345-0@lo:38:kworker.0 Request processed in 64us (158us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787388201.491379:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787388201.491417:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388201.491421:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787388201.491425:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945752704:0@lo:38:kworker.0 00000100:00100000:1.0:1787388201.491648:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945752576:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787388201.493257:0:17074:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787388201.493294:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.493309:0:17074:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388201.493317:0:17074:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996a44056800 from 1 10000000:01000000:1.0:1787388201.493320:0:17074:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787388201.493403:0:17074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.493412:0:17074:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.493422:0:17074:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388201.493445:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945752832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388201.493502:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.493532:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388201.493654:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945752832 00000100:00100000:3.0:1787388201.493663:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945752832 00000100:00100000:3.0:1787388201.493749:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787388201.493757:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+10:17074:x1874211945752832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388201.493770:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388201.493784:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f6c00/0x26817551a447562b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475624 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388201.493808:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f6c00/0x26817551a447562b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475624 expref: 11 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388201.493817:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f6c00/0x26817551a447562b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475624 expref: 11 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388201.493827:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6c00, rc 0) 00000100:00100000:3.0:1787388201.493875:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17074:x1874211945752832:12345-0@lo:101:mount.lustre.0 Request processed in 119us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388201.493881:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787388201.493944:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945752832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388201.493958:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.493967:0:17074:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388201.494037:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945752960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388201.494063:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.500560:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388201.505168:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945752960 00000100:00100000:2.0:1787388201.505183:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945752960 00000100:00100000:2.0:1787388201.505240:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787388201.505250:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17074:x1874211945752960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388201.505455:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17074:x1874211945752960:12345-0@lo:501:mount.lustre.0 Request processed in 205us (11390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388201.505463:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787388201.505668:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945752960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388201.505717:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945753088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388201.505765:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.505788:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388201.505939:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945753088 00000100:00100000:0.0:1787388201.505945:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945753088 00000100:00100000:1.0:1787388201.506085:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787388201.506092:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17074:x1874211945753088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388201.506192:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17074:x1874211945753088:12345-0@lo:503:mount.lustre.0 Request processed in 99us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.506200:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787388201.508015:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945753088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388201.509897:0:17122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17122:1874211945753216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388201.509970:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388201.510016:0:17122:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365780 going to sleep for 11 seconds 00000100:00100000:1.0:1787388201.510069:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945753216 00000100:00100000:1.0:1787388201.510077:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945753216 00000100:00100000:1.0:1787388201.510616:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787388201.510808:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17122:x1874211945753216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388201.518248:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17122:x1874211945753216:12345-0@lo:502:llog_process_th.0 Request processed in 7436us (8269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.518272:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787388201.518615:0:17122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17122:1874211945753216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787388201.518832:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388201.518842:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388201.518845:0:17122:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787388201.519104:0:17122:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996a44056800 00000020:00000080:0.0:1787388201.519118:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388201.519127:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388201.519130:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388201.519131:0:17122:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787388201.519134:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388201.519137:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388201.519139:0:17122:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787388201.519142:0:17122:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996a44056800 00000020:00000080:0.0:1787388201.519144:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388201.519203:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388201.519207:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388201.519208:0:17122:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787388201.519211:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388201.519213:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388201.519214:0:17122:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787388201.519218:0:17122:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996a44056800 00000020:00000080:0.0:1787388201.519220:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388201.519238:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388201.519241:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388201.519242:0:17122:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787388201.519245:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388201.519247:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388201.519248:0:17122:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787388201.519252:0:17122:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996a44056800 00000020:00000080:0.0:1787388201.519254:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787388201.519312:0:17122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17122:1874211945753344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388201.519399:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388201.519431:0:17122:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42365780 going to sleep for 11 seconds 00000100:00100000:1.0:1787388201.519568:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945753344 00000100:00100000:1.0:1787388201.519575:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945753344 00000100:00100000:1.0:1787388201.519623:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787388201.519632:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17122:x1874211945753344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787388201.519751:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17122:x1874211945753344:12345-0@lo:502:llog_process_th.0 Request processed in 119us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.519759:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787388201.520237:0:17122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17122:1874211945753344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787388201.520260:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388201.520275:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388201.520282:0:17122:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787388201.520286:0:17122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787388201.521212:0:17074:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787388201.521295:0:17074:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787388201.521317:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.521330:0:17074:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388201.521407:0:17074:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787388201.521410:0:17074:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996a44056800 10000000:01000000:1.0:1787388201.521413:0:17074:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996a44056800 10000000:01000000:1.0:1787388201.521418:0:17074:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787388201.521424:0:17074:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996a44056800 from 1 10000000:01000000:1.0:1787388201.521427:0:17074:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787388201.521963:0:17074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4f000/0x26817551a4475632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.521974:0:17074:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4f000/0x26817551a4475632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.521984:0:17074:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4f000/0x26817551a4475632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388201.522004:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945753472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388201.522125:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.522164:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945753472 00000100:00100000:1.0:1787388201.522177:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945753472 00000100:00100000:1.0:1787388201.522209:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787388201.522215:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17074:x1874211945753472:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388201.522553:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388201.522568:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f4f400/0x26817551a4475639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475632 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.522588:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f4f400/0x26817551a4475639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475632 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.522598:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f4f400/0x26817551a4475639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475632 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.522607:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f400, rc 0) 00000100:00100000:1.0:1787388201.522636:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17074:x1874211945753472:12345-0@lo:101:mount.lustre.0 Request processed in 421us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388201.522642:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787388201.522680:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388201.522696:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945753472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388201.522708:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4f000/0x26817551a4475632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475639 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.522717:0:17074:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4f000/0x26817551a4475632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475639 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388201.522761:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945753600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388201.522782:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.522801:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388201.523437:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945753600 00000100:00100000:0.0:1787388201.523445:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945753600 00000100:00100000:0.0:1787388201.523482:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787388201.523490:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17074:x1874211945753600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388201.524370:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17074:x1874211945753600:12345-0@lo:501:mount.lustre.0 Request processed in 853us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388201.524380:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787388201.524643:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945753600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388201.524691:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945753728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388201.524737:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.524775:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388201.524934:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945753728 00000100:00100000:0.0:1787388201.524940:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945753728 00000100:00100000:0.0:1787388201.524968:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787388201.524975:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17074:x1874211945753728:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388201.525978:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17074:x1874211945753728:12345-0@lo:503:mount.lustre.0 Request processed in 999us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388201.525988:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787388201.527034:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945753728:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388201.528564:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17125:1874211945753856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388201.528644:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388201.528685:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945753856 00000100:00100000:0.0:1787388201.528691:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945753856 00000100:00100000:0.0:1787388201.528730:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787388201.528740:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17125:x1874211945753856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787388201.529126:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17125:x1874211945753856:12345-0@lo:502:llog_process_th.0 Request processed in 387us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388201.529134:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787388201.529188:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42207cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388201.529206:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17125:1874211945753856:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787388201.529257:0:17125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787388201.529289:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff996b7c5299c0) 00000020:00000080:0.0:1787388201.529308:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787388201.532242:0:17125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996a44056800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787388201.532251:0:17125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996a44056800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787388201.532254:0:17125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996a44056800 4 00010000:00080000:0.0:1787388201.532302:0:17125:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a420cc000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1787388201.545844:0:17125:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787388201.545936:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787388201.545974:0:17125:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787388201.545985:0:17125:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x26817551a4475647 00000100:00080000:0.0:1787388201.545994:0:17125:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787388201.546001:0:17125:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff996a420cc000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1787388201.546032:0:17125:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b738e9880 x1874211945753984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787388201.546063:0:17125:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787388201.546582:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388201.546589:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787388201.546592:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388201.546595:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787388201.551822:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874211945753984:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787388201.551895:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388201.552934:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17125:1874211945754112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388201.552998:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388201.553034:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517f60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388201.554177:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945754112 00000100:00100000:2.0:1787388201.554187:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945754112 00000100:00100000:2.0:1787388201.554273:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787388201.554283:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17125:x1874211945754112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388201.554447:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17125:x1874211945754112:12345-0@lo:502:llog_process_th.0 Request processed in 165us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388201.554461:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787388201.554523:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17125:1874211945754112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388201.554580:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17125:1874211945754240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787388201.554620:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388201.554639:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5249ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388201.555445:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945754240 00000100:00100000:3.0:1787388201.555453:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945754240 00000100:00100000:3.0:1787388201.555495:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787388201.555503:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17125:x1874211945754240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787388201.555625:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17125:x1874211945754240:12345-0@lo:502:llog_process_th.0 Request processed in 122us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388201.555632:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787388201.555680:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17125:1874211945754240:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787388201.555704:0:17125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787388201.556192:0:17074:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787388201.556219:0:17074:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787388201.556242:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4f000/0x26817551a4475632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475639 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.556274:0:17074:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4f000/0x26817551a4475632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475639 expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787388201.556322:0:17074:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787388201.556324:0:17074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787388201.556326:0:17074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388201.556327:0:17074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388201.556329:0:17074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388201.556330:0:17074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388201.556331:0:17074:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787388201.556333:0:17074:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787388201.556334:0:17074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388201.556336:0:17074:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787388201.556339:0:17074:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787388201.556342:0:17074:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787388201.556343:0:17074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787388201.556369:0:17074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388201.556370:0:17074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388201.556372:0:17074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388201.556374:0:17074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388201.556375:0:17074:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787388201.556377:0:17074:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787388201.556378:0:17074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388201.556379:0:17074:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787388201.556399:0:17074:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787388201.556412:0:17074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945754368:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787388201.556607:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388201.556640:0:17074:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42207c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388201.556655:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945754368 00000100:00100000:0.0:1787388201.556659:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945754368 00000100:00100000:0.0:1787388201.556686:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787388201.556692:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17074:x1874211945754368:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787388201.556711:0:17087:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787388201.556728:0:17087:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787388201.556838:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945753984 00000100:00100000:0.0:1787388201.556842:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945753984 00000100:00100000:0.0:1787388201.556859:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388201.556864:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1874211945753984:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787388201.556907:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1874211945753984:12345-0@lo:38:llog_process_th.0 Request processed in 42us (5012us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787388201.556913:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388201.556940:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787388201.556946:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a420cc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388201.556950:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787388201.556953:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874211945753984:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1787388201.563462:0:17087:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787388201.563480:0:17087:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787388201.563588:0:17110:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787388201.563594:0:17110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787388201.563616:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.563635:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b40031e00/0x26817551a447561d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475616 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.563644:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.563681:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b40031e00/0x26817551a447561d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4475616 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388201.563695:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b40031e00/0x26817551a447561d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4475616 expref: 12 pid: 17089 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388201.563710:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945754496:0@lo:104: 00000100:00100000:1.0:1787388201.563771:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388201.563814:0:17110:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388201.564210:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17074:x1874211945754368:12345-0@lo:253:mount.lustre.0 Request processed in 7516us (7601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388201.564220:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787388201.564498:0:17074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17074:1874211945754368:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787388201.564509:0:17074:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787388201.564512:0:17074:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787388201.564514:0:17074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787388201.564515:0:17074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388201.564525:0:17074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388201.564527:0:17074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388201.564528:0:17074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388201.564529:0:17074:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787388201.564530:0:17074:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787388201.564532:0:17074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388201.564534:0:17074:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787388201.564550:0:17074:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787388201.564820:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945754496 00000100:00100000:2.0:1787388201.564826:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945754496 00000100:00100000:2.0:1787388201.564868:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787388201.564876:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:17110:x1874211945754496:12345-0@lo:104: 00010000:00010000:2.0:1787388201.564888:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388201.564946:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388201.564951:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:17110:x1874211945754496:12345-0@lo:104: Request processed in 77us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388201.564957:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388201.564991:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945754496:0@lo:104: 00010000:00010000:0.0:1787388201.565008:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.566173:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388201.566183:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.566193:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e600 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787388201.566197:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.566217:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388201.566225:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388201.566231:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787388201.566283:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.566290:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787388201.566312:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.566319:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b52f4e600/0x26817551a4475616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447561d expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.566337:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388201.566340:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388201.566341:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388201.566398:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945754624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388201.566445:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388201.573606:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945754624 00000100:00100000:0.0:1787388201.573626:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945754624 00010000:00010000:0.0:1787388201.573668:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b40031e00/0x26817551a447561d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475616 expref: 12 pid: 17089 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388201.573713:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388201.573725:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:3650:x1874211945754624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388201.573748:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388201.573756:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b40031e00/0x26817551a447561d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475616 expref: 12 pid: 17089 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573771:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b40031e00/0x26817551a447561d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4475616 expref: 12 pid: 17089 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573790:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40031e00/0x26817551a447561d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4475616 expref: 12 pid: 17089 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573811:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573820:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787388201.573838:0:17080:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010244960s 00010000:00010000:0.0:1787388201.573843:0:17080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573851:0:17080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573857:0:17080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573864:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573870:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e000 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388201.573876:0:17080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573894:0:17080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573912:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.573923:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388201.573992:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:3650:x1874211945754624:12345-0@lo:103:ldlm_bl.0 Request processed in 270us (7545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388201.574000:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388201.574131:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945754624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388201.574162:0:17110:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.574170:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388201.574176:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b52f4e000/0x26817551a447564e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787388201.598285:0:17074:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787388201.598676:0:17074:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787388201.599478:0:17135:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1787388201.599839:0:17135:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1787388201.601877:0:17134:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787388201.601887:0:17134:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787388201.601971:0:17074:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1787388201.605678:0:17135:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787388201.605823:0:17135:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:3.0:1787388201.605963:0:17136:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff996b412ac000 x1874211945754752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388201.605976:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00000040:01000000:1.0:1787388201.606386:0:17074:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787388201.606542:0:17074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787388201.606967:0:17074:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787388201.606975:0:17074:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787388201.607016:0:17074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787388201.608221:0:17074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787388201.608928:0:17074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787388201.608971:0:17074:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787388201.610717:0:17074:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1787388201.612703:0:17074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787388201.614171:0:17074:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787388201.614203:0:17074:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa5d541967988 00100000:10000000:2.0:1787388201.614210:0:17074:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787388201.615212:0:17074:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787388201.615228:0:17074:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787388201.615246:0:17074:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787388201.615280:0:17074:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787388201.620118:0:17074:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787388201.620340:0:17074:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787388201.964685:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787388202.546153:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787388202.546160:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996a44056800 from 7 10000000:01000000:1.0:1787388202.546166:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787388202.546210:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388202.546222:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388202.546233:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388202.546467:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945754880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388202.546759:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388202.546849:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787388202.547072:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945754880 00000100:00100000:1.0:1787388202.547080:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945754880 00000100:00100000:1.0:1787388202.547163:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787388202.547171:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+11:17091:x1874211945754880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388202.547190:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388202.547203:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f4ea00/0x26817551a447565c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475655 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388202.547226:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f4ea00/0x26817551a447565c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475655 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388202.547236:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f4ea00/0x26817551a447565c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475655 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388202.547255:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ea00, rc 0) 00000100:00100000:1.0:1787388202.547302:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17091:x1874211945754880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388202.547309:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787388202.547563:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945754880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388202.547578:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388202.547587:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388202.547639:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945755008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787388202.547669:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388202.548443:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787388202.548872:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945755008 00000100:00100000:0.0:1787388202.548879:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945755008 00000100:00100000:0.0:1787388202.549055:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787388202.549064:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17091:x1874211945755008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787388202.549084:0:17087:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787388202.549103:0:17087:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787388202.549106:0:17087:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787388202.549200:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17091:x1874211945755008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388202.549207:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787388202.549413:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945755008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787388202.549462:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787388202.553019:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388202.553038:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388202.609218:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787388202.668852:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787388202.989611:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388203.629149:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787388203.693806:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:2.0:1787388204.015791:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388204.717157:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787388205.036563:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388205.746865:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787388206.061193:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787388206.483881:0:17379:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787388206.764573:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00000100:00080000:2.0:1787388206.829078:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787388206.829085:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787388206.829089:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787388206.829104:0:16499:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:2.0:1787388206.829110:0:16499:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787388206.829118:0:16499:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff996b5ddf4800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787388206.829139:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f5e3800 x1874211945755264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787388206.829161:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388206.829165:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388206.829168:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388206.829171:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388206.829173:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787388206.829176:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787388206.829178:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996a420cc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787388206.829183:0:16499:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff996a420cc000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1787388206.829192:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945755264:0@lo:38:kworker.0 00000100:00100000:2.0:1787388206.829194:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f5e1180 x1874211945755392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787388206.829243:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388206.829250:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945755136:0@lo:400:kworker.0 00000100:00100000:1.0:1787388206.829278:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388206.829288:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388206.829328:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874211945755392:0@lo:38:kworker.0 00000100:00100000:1.0:1787388206.829376:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388206.829417:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945755264 00000100:00100000:1.0:1787388206.829424:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945755264 00000100:00100000:0.0:1787388206.829463:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945755392 00000100:00100000:0.0:1787388206.829467:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945755392 00000100:00100000:1.0:1787388206.829469:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388206.829476:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1874211945755264:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787388206.829485:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787388206.829489:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874211945755392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787388206.829492:0:17100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787388206.829504:0:17096:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1787388206.829538:0:17096:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x26817551a4475663 00000004:00100000:0.0:1787388206.829557:0:17096:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787388206.829895:0:17096:0:(import.c:65:import_set_state_nolock()) ffff996b62097800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388206.829949:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874211945755392:12345-0@lo:38:kworker.0 Request processed in 458us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388206.829957:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787388206.835473:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945755136 00000100:00100000:3.0:1787388206.835486:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945755136 00000100:00100000:3.0:1787388206.835539:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787388206.835550:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:3652:x1874211945755136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388206.835638:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:3652:x1874211945755136:12345-0@lo:400:kworker.0 Request processed in 91us (6349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388206.835646:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787388206.835701:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945755136:0@lo:400:kworker.0 00010000:00080000:1.0:1787388206.874971:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996b7f5e1180 x1874211945755392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787388206.874993:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787388206.875001:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787388206.875007:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787388206.875010:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a420cc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787388206.875017:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874211945755392:0@lo:38:kworker.0 00000100:00100000:1.0:1787388206.875106:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1874211945755264:12345-0@lo:38:kworker.0 Request processed in 45628us (45827us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787388206.875115:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787388206.876473:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388206.876484:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787388206.876488:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945755264:0@lo:38:kworker.0 00010000:00010000:0.0:1787388207.086874:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787388207.466924:0:17431:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787388207.467787:0:17431:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787388207.790631:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787388208.110627:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787388208.574888:0:17481:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787388208.575109:0:17481:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787388208.817760:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787388209.133101:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388209.839111:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787388210.160592:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388210.860687:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787388211.181556:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388211.884466:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00000100:00080000:3.0:1787388211.949738:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787388211.949744:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787388211.949747:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388211.949755:0:16499:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1787388211.949761:0:16499:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787388211.949767:0:16499:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff996b5ddf4800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388211.949793:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ad180 x1874211945755648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787388211.949833:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945755520:0@lo:400:kworker.0 00000100:00100000:1.0:1787388211.949893:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388211.949948:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945755520 00000100:00100000:1.0:1787388211.949955:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945755520 00000100:00100000:1.0:1787388211.949995:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787388211.950011:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:3652:x1874211945755520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388211.950052:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:3652:x1874211945755520:12345-0@lo:400:kworker.0 Request processed in 42us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388211.950058:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787388211.950094:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945755520:0@lo:400:kworker.0 00000100:00080000:3.0:1787388211.951133:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388211.951141:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388211.951143:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388211.951146:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388211.953085:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945755776:0@lo:400:kworker.0 00000100:00100000:1.0:1787388211.953148:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388211.953230:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945755776 00000100:00100000:1.0:1787388211.953238:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945755776 00000100:00100000:1.0:1787388211.953276:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787388211.953284:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945755776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388211.953332:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945755776:12345-0@lo:400:kworker.0 Request processed in 48us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388211.953339:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787388211.953390:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996b412ad500 x1874211945755776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388211.953402:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945755776:0@lo:400:kworker.0 00000100:00100000:0.0:1787388211.953797:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388201/real 1787388201] req@ffff996b412ae300 x1874211945752192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388211.953815:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b412ae300 x1874211945752192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388211.953823:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388201/real 1787388201] req@ffff996a43908a80 x1874211945752064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388211.953833:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996a43908a80 x1874211945752064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388211.953847:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945755648:0@lo:38:kworker.0 00000100:00100000:0.0:1787388211.953877:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787388211.953905:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a42fcb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388211.953919:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787388211.953923:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945752192:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787388211.953937:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388211.953949:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787388211.953951:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388211.953954:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787388211.953956:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996a42fcb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787388211.953959:0:16499:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 522 00000100:00080000:0.0:1787388211.953963:0:16499:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787388211.953968:0:16499:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff996a42fcb800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1787388211.953992:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b738eb480 x1874211945755904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787388211.954019:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5ddfe000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388211.954028:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787388211.954031:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945752064:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787388211.954056:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388211.954059:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787388211.954061:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996b5ddfe000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787388211.954063:0:16499:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 522 00000100:00080000:0.0:1787388211.954066:0:16499:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787388211.954069:0:16499:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff996b5ddfe000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1787388211.954081:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b738ead80 x1874211945756032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388211.954098:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945755904:0@lo:8:kworker.0 00000400:00000100:0.0:1787388211.954121:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211945755904 offset 0 length 520: 4 00000100:00100000:0.0:1787388211.954145:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945756032:0@lo:8:kworker.0 00000400:00000100:0.0:1787388211.954174:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211945756032 offset 0 length 520: 4 00000100:00100000:1.0:1787388211.956624:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945755648 00000100:00100000:1.0:1787388211.956639:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945755648 00000100:00100000:1.0:1787388211.956883:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787388211.956892:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1874211945755648:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787388211.956912:0:17099:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787388211.997647:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1874211945755648:12345-0@lo:38:kworker.0 Request processed in 40748us (43760us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787388211.997661:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787388212.002609:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787388212.002620:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787388212.002625:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945755648:0@lo:38:kworker.0 00010000:00010000:1.0:1787388212.211831:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388212.915214:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787388213.232992:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388213.872643:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787388213.937424:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787388214.255695:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388214.957534:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787388215.279967:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787388215.681423:0:17826:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787388215.681426:0:17826:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787388215.681428:0:17826:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787388215.681879:0:17826:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff996b73a8a800 00000020:01000004:3.0:1787388215.681897:0:17826:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787388215.681908:0:17826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787388215.681922:0:17826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff996b739ccd40) 00000020:00000080:3.0:1787388215.681939:0:17826:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787388215.749765:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.750033:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787388215.753526:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.753778:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.754014:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.754217:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.754508:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.754708:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.754992:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.755239:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.755544:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.755903:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.756107:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.756440:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.756816:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.757131:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.757464:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.757666:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.758205:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.758505:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.758732:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.759054:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.759486:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.759716:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.760020:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.760238:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.760544:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.760803:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.761031:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.761273:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.761547:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.761755:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.762042:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787388215.762322:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787388215.763008:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787388215.763526:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787388215.763775:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787388215.764038:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787388215.764234:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787388215.764521:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787388215.764775:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787388215.765036:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787388215.765235:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787388215.765462:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787388215.765651:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787388215.765898:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1787388215.767568:0:17826:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787388215.767811:0:17826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787388215.767821:0:17826:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787388215.767835:0:17826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a4475671 00000020:01000004:1.0:1787388215.767842:0:17826:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787388215.767862:0:17826:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787388215.767865:0:17826:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787388215.767870:0:17826:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787388215.767893:0:17826:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787388215.767896:0:17826:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787388215.773151:0:17826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787388215.773207:0:17826:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.115@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787388215.773211:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787388215.773213:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787388215.773214:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388215.773216:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388215.773217:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388215.773218:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388215.773219:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787388215.773221:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388215.773222:0:17826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787388215.773226:0:17826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787388215.773228:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787388215.773229:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787388215.773231:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388215.773232:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388215.773233:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388215.773234:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388215.773235:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787388215.773236:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388215.773237:0:17826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787388215.773263:0:17826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787388215.773284:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756160:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787388215.773600:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388215.773723:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b52d32840 going to sleep for 11 seconds 00000100:00100000:3.0:1787388215.773864:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945756160 00000100:00100000:3.0:1787388215.773872:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945756160 00000100:00100000:3.0:1787388215.773954:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787388215.773963:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17826:x1874211945756160:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787388215.774015:0:17087:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787388215.774019:0:17087:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787388215.774026:0:17087:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787388215.774427:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17826:x1874211945756160:12345-0@lo:253:mount.lustre.0 Request processed in 464us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388215.774436:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787388215.774527:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756160:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787388215.774539:0:17826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787388215.774542:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787388215.774543:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787388215.774544:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388215.774546:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388215.774547:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388215.774548:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388215.774549:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787388215.774551:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388215.774552:0:17826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787388215.774569:0:17826:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996b73a8a800 from lustre-MDT0001 10000000:01000000:2.0:1787388215.774600:0:17826:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787388215.774603:0:17826:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787388215.774609:0:17826:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff996b72b80000 local copy 00010000:00010000:2.0:1787388215.774619:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388215.774699:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388215.774730:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.775109:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b52d32840 going to sleep for 11 seconds 00000100:00100000:1.0:1787388215.775196:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945756288 00000100:00100000:1.0:1787388215.775210:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945756288 00000100:00100000:1.0:1787388215.775236:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787388215.775243:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17826:x1874211945756288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388215.775311:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17826:x1874211945756288:12345-0@lo:501:mount.lustre.0 Request processed in 68us (581us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787388215.775318:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787388215.775630:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756288:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787388215.775643:0:17826:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787388215.775673:0:17826:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787388215.775680:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.775689:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388215.775722:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996b73a8a800 10000000:01000000:2.0:1787388215.775727:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787388215.775731:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff996b72b80000 10000000:01000000:2.0:1787388215.775734:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787388215.775813:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff996b72b80000 from 1 10000000:01000000:2.0:1787388215.775816:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787388215.775842:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5dc00/0x26817551a4475678 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.775849:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f5dc00/0x26817551a4475678 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.775857:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f5dc00/0x26817551a4475678 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388215.775870:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388215.775901:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.775925:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b52d32840 going to sleep for 11 seconds 00000100:00100000:1.0:1787388215.775994:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945756416 00000100:00100000:1.0:1787388215.775998:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945756416 00000100:00100000:1.0:1787388215.776020:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787388215.776026:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+12:17826:x1874211945756416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388215.776034:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388215.776047:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f4ec00/0x26817551a447567f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475678 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388215.776066:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f4ec00/0x26817551a447567f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475678 expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388215.776075:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f4ec00/0x26817551a447567f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475678 expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388215.776083:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ec00, rc 0) 00000100:00100000:1.0:1787388215.776112:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+13:17826:x1874211945756416:12345-0@lo:101:mount.lustre.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388215.776118:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787388215.776259:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388215.776270:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f5dc00/0x26817551a4475678 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447567f expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.776279:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f5dc00/0x26817551a4475678 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447567f expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388215.776294:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787388215.776313:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5dc00/0x26817551a4475678 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447567f expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.776332:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5dc00/0x26817551a4475678 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447567f expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388215.776436:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff996b73a8a800 10000000:01000000:2.0:1787388215.776441:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787388215.776444:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff996b73a8a800 from 1 10000000:01000000:2.0:1787388215.776446:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787388215.776468:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5d400/0x26817551a4475686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.776475:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f5d400/0x26817551a4475686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.776482:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f5d400/0x26817551a4475686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388215.776494:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388215.776523:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.776536:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b52d32840 going to sleep for 11 seconds 00000100:00100000:1.0:1787388215.776654:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945756544 00000100:00100000:1.0:1787388215.776660:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945756544 00000100:00100000:1.0:1787388215.776681:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787388215.776687:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+13:17826:x1874211945756544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388215.776704:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388215.776713:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f4f600/0x26817551a447568d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475686 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388215.776727:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f4f600/0x26817551a447568d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475686 expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388215.776746:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f4f600/0x26817551a447568d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475686 expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388215.776755:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4f600, rc 0) 00000100:00100000:1.0:1787388215.776781:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+14:17826:x1874211945756544:12345-0@lo:101:mount.lustre.0 Request processed in 95us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388215.776787:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787388215.777051:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388215.777064:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f5d400/0x26817551a4475686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447568d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.777072:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f5d400/0x26817551a4475686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447568d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388215.777085:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787388215.777099:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5d400/0x26817551a4475686 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447568d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.777113:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5d400/0x26817551a4475686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447568d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388215.777119:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787388215.777123:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787388215.777127:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff996b73a8a800 10000000:01000000:2.0:1787388215.777131:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787388215.777134:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787388215.777137:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787388215.777151:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5d200/0x26817551a4475694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.777157:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f5d200/0x26817551a4475694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.777164:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f5d200/0x26817551a4475694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388215.777188:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388215.777214:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.777241:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b52d32840 going to sleep for 11 seconds 00000100:00100000:3.0:1787388215.777299:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945756672 00000100:00100000:3.0:1787388215.777303:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945756672 00000100:00100000:3.0:1787388215.777336:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787388215.777372:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+14:17826:x1874211945756672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388215.777380:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388215.777388:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f7c00/0x26817551a447569b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475694 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.777402:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f7c00/0x26817551a447569b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475694 expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.777409:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f7c00/0x26817551a447569b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475694 expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.777416:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7c00, rc 0) 00000100:00100000:3.0:1787388215.777445:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+15:17826:x1874211945756672:12345-0@lo:101:mount.lustre.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388215.777452:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787388215.777645:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388215.777656:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f5d200/0x26817551a4475694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447569b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.777665:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f5d200/0x26817551a4475694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447569b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388215.778945:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1787388215.779600:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787388215.783221:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787388215.783273:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787388215.783287:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787388215.783298:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787388215.783312:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1787388215.783325:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1787388215.783338:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1787388215.783459:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787388215.783473:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787388215.783484:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1787388215.783496:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1787388215.783508:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1787388215.783522:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1787388215.783533:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787388215.783546:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787388215.783557:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1787388215.783570:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787388215.783584:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787388215.783598:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1787388215.783610:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787388215.783628:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787388215.783640:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787388215.783652:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787388215.783679:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1787388215.783685:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1787388215.783869:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388215.783936:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.783981:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4528dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388215.784066:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945756800 00000100:00100000:3.0:1787388215.784074:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945756800 00000100:00100000:3.0:1787388215.784153:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787388215.784162:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+15:17826:x1874211945756800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388215.784963:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+15:17826:x1874211945756800:12345-0@lo:501:mount.lustre.0 Request processed in 798us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388215.784973:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787388215.788975:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388215.789042:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388215.789121:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388215.789216:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b821efb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388215.796395:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945756928 00000100:00100000:3.0:1787388215.796411:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945756928 00000100:00100000:3.0:1787388215.796472:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787388215.796482:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+15:17826:x1874211945756928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388215.797459:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+15:17826:x1874211945756928:12345-0@lo:503:mount.lustre.0 Request processed in 974us (8333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388215.797470:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787388215.797595:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945756928:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787388215.798038:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787388215.798113:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945757056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388215.798161:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.798202:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4528d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388215.798388:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945757056 00000100:00100000:3.0:1787388215.798393:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945757056 00000100:00100000:3.0:1787388215.798428:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787388215.798436:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+15:17826:x1874211945757056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388215.799375:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+15:17826:x1874211945757056:12345-0@lo:502:mount.lustre.0 Request processed in 933us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388215.799385:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787388215.799541:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945757056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388215.799811:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787388215.799845:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1787388215.799864:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1787388215.799879:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1787388215.799892:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1787388215.799904:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1787388215.799917:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1787388215.799930:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1787388215.799943:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1787388215.799957:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1787388215.799969:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1787388215.799983:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1787388215.799998:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1787388215.800012:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1787388215.800024:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1787388215.800034:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1787388215.800045:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1787388215.800056:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1787388215.800070:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1787388215.800081:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1787388215.800093:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1787388215.800107:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1787388215.800122:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1787388215.800138:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1787388215.800175:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1787388215.800193:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1787388215.800207:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1787388215.800220:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1787388215.800232:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1787388215.800244:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1787388215.800257:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1787388215.800271:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1787388215.800285:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1787388215.800299:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1787388215.800312:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1787388215.800324:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1787388215.800335:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1787388215.801461:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1787388215.801504:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1787388215.801521:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1787388215.801546:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1787388215.801561:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1787388215.801575:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1787388215.801588:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1787388215.801631:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945757184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388215.801706:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388215.801996:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945757184 00000100:00100000:3.0:1787388215.802005:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945757184 00000100:00100000:3.0:1787388215.802059:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787388215.802069:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+15:17826:x1874211945757184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388215.802189:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+15:17826:x1874211945757184:12345-0@lo:502:mount.lustre.0 Request processed in 121us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388215.802197:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787388215.802280:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4528d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787388215.802304:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945757184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388215.802630:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1787388215.802642:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787388215.806865:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388215.806881:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388215.806884:0:17830:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787388215.806891:0:17830:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787388215.806894:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388215.806931:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff996b7c754d40) 00000020:00000080:1.0:1787388215.806957:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787388215.806964:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787388215.807042:0:17830:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787388215.807048:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a44756a9 00000020:00000080:1.0:1787388215.807283:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787388215.807289:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388215.807293:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388215.807295:0:17830:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787388215.807298:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388215.807301:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388215.807307:0:17830:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787388215.807311:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388215.807318:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff996b7c7519c0) 00000020:00000080:1.0:1787388215.807328:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787388215.807331:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787388215.807333:0:17830:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787388215.807336:0:17830:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787388215.807373:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787388215.807428:0:17830:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b73a8a800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787388215.807440:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff996b7c753380) 00000020:00000080:1.0:1787388215.807449:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787388215.807498:0:17830:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787388215.807502:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a44756be 00000020:00000080:1.0:1787388215.807604:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787388215.807610:0:17830:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787388215.807614:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x26817551a44756c5 00080000:01000000:1.0:1787388215.807619:0:17830:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787388215.807622:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a44756cc 00010000:00010000:2.0:1787388215.883732:0:17830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787388215.884280:0:17830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1787388215.884846:0:17830:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787388215.888193:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787388215.888216:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388215.888222:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.888224:0:17830:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787388215.888228:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388215.888234:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.888235:0:17830:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787388215.888238:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787388215.888244:0:17830:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:00000080:2.0:1787388215.888270:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787388215.888286:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff996a4338cd40) 00000020:00000080:2.0:1787388215.888305:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787388215.888310:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787388215.888424:0:17830:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787388215.888430:0:17830:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787388215.888437:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a44756da 00010000:00080000:2.0:1787388215.888466:0:17830:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a43025800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1787388215.895544:0:17830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787388215.898201:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787388215.898216:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787388215.898255:0:17830:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787388215.898275:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a44756e1 00000100:00080000:1.0:1787388215.898285:0:17830:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787388215.898291:0:17830:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff996a43025800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1787388215.898322:0:17830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996a43908000 x1874211945757312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388215.898371:0:17830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787388215.898396:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787388215.898400:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787388215.898402:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388215.898406:0:16499:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:1.0:1787388215.898416:0:16499:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787388215.898421:0:16499:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff996b5ddf4800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1787388215.898434:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996a43909180 x1874211945757440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388215.898443:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388215.898446:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388215.898449:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388215.898452:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388215.898480:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787388215.898491:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945757568:0@lo:400:kworker.0 00000100:00100000:1.0:1787388215.898552:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787388215.898638:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388215.898642:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388215.898644:0:17830:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787388215.898647:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787388215.898650:0:17830:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787388215.898651:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388215.898653:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388215.898655:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787388215.898657:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388215.898658:0:17830:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787388215.898661:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388215.898665:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388215.898666:0:17830:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787388215.898670:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787388215.898701:0:17830:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787388215.898727:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388215.898731:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388215.898733:0:17830:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787388215.899007:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787388215.899009:0:17830:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1787388215.899010:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388215.899011:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388215.899012:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787388215.899016:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388215.899017:0:17830:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787388215.899019:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787388215.899022:0:17830:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787388215.899026:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388215.899027:0:17830:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787388215.899030:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787388215.899034:0:17830:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:1.0:1787388215.899055:0:17830:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787388215.899058:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388215.899070:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff996b7c750000) 00000020:00000080:1.0:1787388215.899083:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787388215.899089:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787388215.899154:0:17830:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787388215.899213:0:17830:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787388215.899221:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a44756ef 00010000:00080000:1.0:1787388215.899252:0:17830:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a423b5800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:1.0:1787388215.899673:0:17830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1787388215.899893:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945757312:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787388215.899948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388215.899983:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945757440:0@lo:38:kworker.0 00000100:00100000:0.0:1787388215.900006:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388215.900046:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945757568 00000100:00100000:0.0:1787388215.900053:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945757568 00000100:00100000:0.0:1787388215.900095:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787388215.900104:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945757568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388215.900155:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945757568:12345-0@lo:400:kworker.0 Request processed in 52us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388215.900176:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787388215.900199:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945757312 00000100:00100000:0.0:1787388215.900202:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945757312 00000100:00100000:0.0:1787388215.900214:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945757440 00000100:00100000:0.0:1787388215.900216:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945757440 00000100:00100000:0.0:1787388215.900226:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787388215.900230:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1874211945757312:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787388215.900249:0:17100:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:0.0:1787388215.900279:0:17100:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a44756f6 00000004:00100000:0.0:1787388215.900293:0:17100:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787388215.900306:0:17100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:0.0:1787388215.901072:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996a4390a300 x1874211945757568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388215.901087:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945757568:0@lo:400:kworker.0 00000040:01000000:1.0:1787388215.901998:0:17830:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787388215.902266:0:17830:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1787388215.907991:0:17100:0:(import.c:65:import_set_state_nolock()) ffff996a43398000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388215.908088:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1874211945757312:12345-0@lo:38:llog_process_th.0 Request processed in 7854us (8138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388215.908099:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787388215.908127:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787388215.908133:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1874211945757440:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787388215.908185:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1874211945757440:12345-0@lo:38:kworker.0 Request processed in 50us (8176us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787388215.908191:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1787388215.908507:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787388215.908732:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787388215.908817:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787388215.908838:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787388215.908844:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787388215.908847:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a43025800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787388215.908863:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945757312:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787388215.908878:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787388215.908882:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787388215.908885:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787388215.908887:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945757440:0@lo:38:kworker.0 00000100:00100000:2.0:1787388215.909295:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945757696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388215.909624:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787388215.909691:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:0.0:1787388215.909962:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945757696 00000100:00100000:0.0:1787388215.909969:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945757696 00000100:00100000:0.0:1787388215.910480:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787388215.910493:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874211945757696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388215.910525:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787388215.910589:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874211945757696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388215.910596:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787388215.910659:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945757696:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787388215.911072:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1787388215.911514:0:17835:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787388215.911519:0:17835:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787388215.912307:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787388215.912321:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787388215.912410:0:17830:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787388215.912433:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a44756fd 00000100:00080000:2.0:1787388215.912441:0:17830:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787388215.912447:0:17830:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff996a423b5800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787388215.912479:0:17830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f5e1500 x1874211945757824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787388215.912521:0:17830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787388215.912574:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388215.912579:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.912580:0:17830:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787388215.912583:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787388215.912586:0:17830:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1787388215.912587:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787388215.912588:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787388215.912589:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787388215.912592:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.912593:0:17830:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787388215.912595:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787388215.912599:0:17830:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787388215.912602:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.912603:0:17830:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787388215.912606:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787388215.912609:0:17830:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:2.0:1787388215.912631:0:17830:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787388215.912634:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787388215.912645:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff996b7bdfcd40) 00000020:00000080:2.0:1787388215.912657:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1787388215.912662:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787388215.912875:0:17830:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787388215.912882:0:17830:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787388215.912887:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26817551a447570b 00010000:00080000:2.0:1787388215.912913:0:17830:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a43023800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1787388215.913127:0:17830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787388215.913199:0:17830:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787388215.913212:0:17830:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1787388215.913943:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945757824:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787388215.913997:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211945757824 offset 0 length 520: 4 00000100:00080000:1.0:1787388215.914388:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388215.914394:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388215.914397:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388215.914400:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787388215.916292:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787388215.918584:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787388215.918921:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787388215.919516:0:17837:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787388215.919521:0:17837:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787388215.920623:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787388215.920692:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787388215.920884:0:17830:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787388215.920906:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a4475712 00000100:00080000:3.0:1787388215.920915:0:17830:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787388215.920922:0:17830:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff996a43023800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388215.920966:0:17830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ad180 x1874211945757952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388215.921025:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945757952:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787388215.921081:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211945757952 offset 0 length 520: 4 00000100:00080000:3.0:1787388215.921134:0:17830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787388215.921208:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388215.921219:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388215.921221:0:17830:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787388215.921225:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388215.921229:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388215.921231:0:17830:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787388215.921234:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787388215.921236:0:17830:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787388215.921238:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388215.921241:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388215.921242:0:17830:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787388215.921245:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787388215.921247:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388215.921248:0:17830:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787388215.921252:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787388215.921278:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787388215.921282:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787388215.921283:0:17830:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787388215.921286:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1787388215.921655:0:17826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787388215.921691:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787388215.921723:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5d200/0x26817551a4475694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447569b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.921743:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5d200/0x26817551a4475694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447569b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388215.921752:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b73a8a800 from 1 10000000:01000000:2.0:1787388215.921755:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787388215.921782:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.921790:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.921800:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388215.921817:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388215.921862:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.921887:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b59941900 going to sleep for 11 seconds 00000100:00100000:3.0:1787388215.922128:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945758080 00000100:00100000:3.0:1787388215.922134:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945758080 00000100:00100000:3.0:1787388215.922188:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787388215.922197:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+15:17826:x1874211945758080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388215.922211:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388215.922222:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f7400/0x26817551a4475720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475719 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.922243:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f7400/0x26817551a4475720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475719 expref: 16 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.922253:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f7400/0x26817551a4475720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475719 expref: 16 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.922262:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7400, rc 0) 00000100:00100000:3.0:1787388215.922304:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+16:17826:x1874211945758080:12345-0@lo:101:mount.lustre.0 Request processed in 108us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388215.922310:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787388215.922425:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758080:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388215.922439:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.922449:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388215.923084:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758208:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787388215.923128:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.923154:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b59941900 going to sleep for 11 seconds 00000100:00080000:1.0:1787388215.923388:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388215.923400:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388215.923403:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388215.923406:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787388215.923546:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945758208 00000100:00100000:2.0:1787388215.923552:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945758208 00000100:00100000:2.0:1787388215.923589:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787388215.923598:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+16:17826:x1874211945758208:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787388215.923614:0:17087:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787388215.923632:0:17087:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787388215.923635:0:17087:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787388215.923846:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+16:17826:x1874211945758208:12345-0@lo:256:mount.lustre.0 Request processed in 249us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388215.923854:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787388215.923959:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758208:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787388215.924934:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787388215.925000:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388215.925012:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388215.925022:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b73a8a800 from 1 10000000:01000000:1.0:1787388215.925025:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787388215.925056:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388215.925064:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388215.925073:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388215.925092:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388215.925139:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388215.925185:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72981e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388215.925312:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945758336 00000100:00100000:2.0:1787388215.925319:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945758336 00000100:00100000:2.0:1787388215.925384:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787388215.925393:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+16:17826:x1874211945758336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388215.925405:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388215.925418:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f5c600/0x26817551a447572e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475727 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.925438:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f5c600/0x26817551a447572e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475727 expref: 17 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.925448:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f5c600/0x26817551a447572e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475727 expref: 17 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.925456:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c600, rc 0) 00000100:00100000:2.0:1787388215.925494:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17826:x1874211945758336:12345-0@lo:101:mount.lustre.0 Request processed in 102us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388215.925510:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787388215.925650:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388215.925664:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388215.925678:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388215.925841:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787388215.925871:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388215.925898:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388215.925929:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72981240 going to sleep for 11 seconds 00000100:00100000:0.0:1787388215.926044:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945758464 00000100:00100000:0.0:1787388215.926049:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945758464 00000100:00100000:0.0:1787388215.926075:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787388215.926088:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17826:x1874211945758464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388215.926186:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17826:x1874211945758464:12345-0@lo:501:mount.lustre.0 Request processed in 98us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388215.926193:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787388215.926543:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388215.926569:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388215.926609:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388215.926635:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72981240 going to sleep for 11 seconds 00000100:00100000:0.0:1787388215.926677:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945758592 00000100:00100000:0.0:1787388215.926681:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945758592 00000100:00100000:0.0:1787388215.926720:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787388215.926727:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17826:x1874211945758592:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388215.926817:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17826:x1874211945758592:12345-0@lo:503:mount.lustre.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388215.926824:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388215.927025:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787388215.927505:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787388215.927573:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388215.927616:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.927644:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787388215.927724:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945758720 00000100:00100000:1.0:1787388215.927729:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945758720 00000100:00100000:1.0:1787388215.927771:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787388215.927778:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17826:x1874211945758720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388215.927865:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17826:x1874211945758720:12345-0@lo:502:mount.lustre.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388215.927872:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787388215.928187:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388215.928396:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787388215.928421:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1787388215.928441:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1787388215.928453:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1787388215.928466:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1787388215.928478:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1787388215.928489:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1787388215.928500:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1787388215.928512:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787388215.928524:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1787388215.928536:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1787388215.928561:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388215.928601:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.928619:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43af3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787388215.928858:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945758848 00000100:00100000:1.0:1787388215.928864:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945758848 00000100:00100000:1.0:1787388215.928906:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787388215.928912:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17826:x1874211945758848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388215.928998:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17826:x1874211945758848:12345-0@lo:502:mount.lustre.0 Request processed in 85us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388215.929005:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787388215.929137:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388215.929193:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1787388215.929202:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787388215.929884:0:17839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388215.929895:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.929903:0:17839:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787388215.929911:0:17839:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b73a8a800 00000020:00000080:2.0:1787388215.929914:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388215.929923:0:17839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388215.929925:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.929927:0:17839:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787388215.929929:0:17839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388215.929931:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.929933:0:17839:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787388215.929936:0:17839:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b73a8a800 00000020:00000080:2.0:1787388215.929938:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388215.929995:0:17839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388215.929999:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.930001:0:17839:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787388215.930003:0:17839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388215.930006:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.930007:0:17839:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388215.930011:0:17839:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b73a8a800 00000020:00000080:2.0:1787388215.930013:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388215.930030:0:17839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388215.930032:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.930033:0:17839:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388215.930036:0:17839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388215.930038:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.930039:0:17839:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787388215.930043:0:17839:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b73a8a800 00000020:00000080:2.0:1787388215.930045:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388215.930068:0:17839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388215.930071:0:17839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388215.930073:0:17839:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787388215.930076:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1787388215.930200:0:17826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787388215.930226:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388215.930244:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.930254:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388215.930305:0:17826:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787388215.930307:0:17826:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996b73a8a800 10000000:01000000:3.0:1787388215.930310:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996b73a8a800 10000000:01000000:3.0:1787388215.930314:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787388215.930319:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b73a8a800 from 1 10000000:01000000:3.0:1787388215.930321:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787388215.930379:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f6000/0x26817551a4475735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.930388:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a432f6000/0x26817551a4475735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.930397:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a432f6000/0x26817551a4475735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388215.930416:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787388215.930462:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388215.930493:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945758976 00000100:00100000:3.0:1787388215.930498:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945758976 00000100:00100000:3.0:1787388215.930536:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787388215.930544:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17826:x1874211945758976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388215.930554:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388215.930566:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f7600/0x26817551a447573c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475735 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.930586:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f7600/0x26817551a447573c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475735 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.930596:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f7600/0x26817551a447573c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475735 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.930604:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7600, rc 0) 00000100:00100000:3.0:1787388215.930633:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945758976:12345-0@lo:101:mount.lustre.0 Request processed in 89us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388215.930639:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787388215.930668:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5dd680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388215.930685:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945758976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388215.930698:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a432f6000/0x26817551a4475735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447573c expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388215.930723:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a432f6000/0x26817551a4475735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447573c expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787388215.935409:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787388215.935701:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787388215.937291:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787388215.937324:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1787388215.937391:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1787388215.937418:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1787388215.937432:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1787388215.937444:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1787388215.937456:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1787388215.937469:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1787388215.937483:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1787388215.937495:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1787388215.937506:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1787388215.937519:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1787388215.937532:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1787388215.937546:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1787388215.937559:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1787388215.937584:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1787388215.937600:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1787388215.937611:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1787388215.937624:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1787388215.937637:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1787388215.937650:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1787388215.937662:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1787388215.937676:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1787388215.937689:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1787388215.937701:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1787388215.937729:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1787388215.939500:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1787388215.939531:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1787388215.939560:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1787388215.939566:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787388215.939673:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388215.942243:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388215.942302:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945759104 00000100:00100000:3.0:1787388215.942310:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945759104 00000100:00100000:0.0:1787388215.942578:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5dd68a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787388215.943110:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787388215.943127:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388215.943302:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759104:12345-0@lo:501:mount.lustre.0 Request processed in 177us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388215.943310:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787388215.944080:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388215.944133:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388215.944197:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388215.944269:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388215.944826:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945759232 00000100:00100000:0.0:1787388215.944844:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945759232 00000100:00100000:0.0:1787388215.944886:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787388215.944893:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388215.944989:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759232:12345-0@lo:503:mount.lustre.0 Request processed in 98us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388215.944995:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787388215.950398:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759232:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787388215.951288:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787388215.951411:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388215.951479:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388215.951520:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b452ccc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388215.955930:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945759360 00000100:00100000:1.0:1787388215.955944:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945759360 00000100:00100000:1.0:1787388215.956001:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787388215.956010:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388215.956179:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759360:12345-0@lo:502:mount.lustre.0 Request processed in 157us (4687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388215.956187:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787388215.956914:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787388215.957205:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787388215.957237:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1787388215.957252:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1787388215.957265:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1787388215.957278:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1787388215.957290:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1787388215.957302:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1787388215.957315:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1787388215.957329:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1787388215.957342:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1787388215.957376:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1787388215.957389:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1787388215.957401:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1787388215.957414:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1787388215.957442:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1787388215.957457:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1787388215.957469:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1787388215.957481:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1787388215.957493:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1787388215.957506:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1787388215.957519:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1787388215.957545:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1787388215.957560:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1787388215.957575:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1787388215.957586:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1787388215.957598:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1787388215.957609:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1787388215.957625:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1787388215.957637:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1787388215.957649:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1787388215.957676:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1787388215.957688:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1787388215.957848:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1787388215.957868:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1787388215.957879:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1787388215.957891:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1787388215.957902:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1787388215.957914:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1787388215.957926:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1787388215.957939:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1787388215.957951:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1787388215.957963:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1787388215.957975:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1787388215.957987:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1787388215.958000:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1787388215.958013:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1787388215.958040:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1787388215.958055:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1787388215.958102:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388215.958175:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388215.958214:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b452ccc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388215.958401:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945759488 00000100:00100000:1.0:1787388215.958408:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945759488 00000100:00100000:1.0:1787388215.958453:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787388215.958462:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388215.958571:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759488:12345-0@lo:502:mount.lustre.0 Request processed in 109us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388215.958579:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787388215.958892:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787388215.959041:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1787388215.959063:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1787388215.959082:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388215.959115:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388215.959191:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b452ccc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388215.965779:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945759616 00000100:00100000:1.0:1787388215.965791:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945759616 00000100:00100000:1.0:1787388215.965848:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787388215.965857:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388215.966010:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759616:12345-0@lo:502:mount.lustre.0 Request processed in 154us (6893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388215.966018:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787388215.966722:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388215.966821:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1787388215.966836:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787388215.971236:0:17844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787388215.971266:0:17844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff996b48340000) 00000020:00000080:1.0:1787388215.971297:0:17844:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787388215.971472:0:17844:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b73a8a800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787388215.971477:0:17844:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b73a8a800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787388215.971479:0:17844:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b73a8a800 3 00010000:00080000:1.0:1787388215.971516:0:17844:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996b4834e800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1787388215.977667:0:17844:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787388215.977765:0:17844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787388215.977815:0:17844:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787388215.977826:0:17844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x26817551a447574a 00000100:00080000:3.0:1787388215.977837:0:17844:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787388215.977843:0:17844:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff996b4834e800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388215.977874:0:17844:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412af800 x1874211945759744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388215.977905:0:17844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787388215.978083:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874211945759744:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787388215.978150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388215.978221:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945759744 00000100:00100000:1.0:1787388215.978228:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945759744 00000100:00100000:1.0:1787388215.978266:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388215.978274:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874211945759744:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787388215.978296:0:17096:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1787388215.978338:0:17096:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x26817551a4475751 00000004:00100000:1.0:1787388215.978378:0:17096:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787388215.978403:0:17096:0:(import.c:65:import_set_state_nolock()) ffff996b4834f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787388215.978451:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874211945759744:12345-0@lo:38:llog_process_th.0 Request processed in 176us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388215.978459:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787388215.978490:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996b412af800 x1874211945759744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388215.978499:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787388215.978506:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787388215.978514:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787388215.978524:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787388215.978526:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b4834e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787388215.978533:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874211945759744:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787388215.979214:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388215.979220:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388215.979228:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388215.979231:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388215.980614:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00000040:00080000:3.0:1787388215.986282:0:17844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1787388215.986497:0:17826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787388215.986529:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787388215.986552:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f6000/0x26817551a4475735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447573c expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388215.986564:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a432f6000/0x26817551a4475735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447573c expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787388215.986611:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787388215.986613:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787388215.986614:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388215.986615:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388215.986616:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388215.986617:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388215.986619:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787388215.986620:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388215.986621:0:17826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787388215.986625:0:17826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787388215.986628:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787388215.986629:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787388215.986630:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388215.986631:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388215.986632:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388215.986633:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388215.986634:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787388215.986635:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388215.986636:0:17826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787388215.986660:0:17826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787388215.986679:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759872:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787388215.986759:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388215.986799:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517e8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388215.987021:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945759872 00000100:00100000:1.0:1787388215.987029:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945759872 00000100:00100000:1.0:1787388215.987075:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787388215.987085:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759872:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787388215.987110:0:17088:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787388215.987124:0:17088:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787388216.001462:0:17075:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787388216.001562:0:17088:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787388216.001579:0:17088:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787388216.001845:0:17110:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787388216.001850:0:17110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787388216.001872:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388216.001889:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b52f4ea00/0x26817551a447565c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475655 expref: 18 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388216.001897:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a432f7400/0x26817551a4475720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475719 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388216.001905:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388216.001941:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a432f7400/0x26817551a4475720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4475719 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388216.001954:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a432f7400/0x26817551a4475720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4475719 expref: 18 pid: 17089 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388216.001979:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945760000:0@lo:104: 00000100:00100000:1.0:1787388216.002036:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787388216.002076:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b52f4ea00/0x26817551a447565c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4475655 expref: 18 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388216.002084:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b52f4ea00/0x26817551a447565c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4475655 expref: 18 pid: 17088 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388216.002092:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945760128:0@lo:104: 00000100:00100000:1.0:1787388216.002114:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388216.002129:0:17110:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787388216.002209:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945760000 00000100:00100000:2.0:1787388216.002216:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945760000 00000100:00100000:2.0:1787388216.002247:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945760128 00000100:00100000:2.0:1787388216.002249:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945760128 00000100:00100000:2.0:1787388216.002260:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787388216.002268:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+4:17110:x1874211945760000:12345-0@lo:104: 00010000:00010000:2.0:1787388216.002279:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388216.002434:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945760000:0@lo:104: 00010000:00010000:2.0:1787388216.002471:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388216.002477:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+4:17110:x1874211945760000:12345-0@lo:104: Request processed in 210us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388216.002483:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787388216.002500:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787388216.002506:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:17110:x1874211945760128:12345-0@lo:104: 00010000:00010000:2.0:1787388216.002513:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388216.002554:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787388216.002559:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:17110:x1874211945760128:12345-0@lo:104: Request processed in 55us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388216.002565:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787388216.002581:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388216.002586:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388216.002594:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5de00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388216.002605:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388216.002613:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388216.002621:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388216.002626:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787388216.002656:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388216.002662:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388216.002680:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388216.002687:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b52f5de00/0x26817551a4475719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475720 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388216.002697:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388216.002700:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388216.003470:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388216.003541:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17826:x1874211945759872:12345-0@lo:253:mount.lustre.0 Request processed in 16454us (16778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388216.003551:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1787388216.003627:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fa00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388216.003631:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388216.003640:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388216.003658:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388216.003664:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787388216.003698:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388216.003833:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945760128:0@lo:104: 00010000:00010000:1.0:1787388216.003854:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388216.003885:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787388216.003924:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945760384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388216.003960:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388216.004010:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388216.004019:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447565c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388216.004033:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388216.004035:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388216.004036:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388216.004046:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945760256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388216.004070:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388216.004112:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17826:1874211945759872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787388216.004122:0:17826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787388216.004125:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787388216.004127:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787388216.004128:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388216.004129:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388216.004130:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388216.004131:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388216.004133:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787388216.004134:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388216.004135:0:17826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787388216.004151:0:17826:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787388216.005144:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945760384 00000100:00100000:0.0:1787388216.005154:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945760384 00010000:00010000:0.0:1787388216.005192:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b52f4ea00/0x26817551a447565c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475655 expref: 18 pid: 17088 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388216.005227:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945760256 00000100:00100000:0.0:1787388216.005230:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945760256 00010000:00010000:0.0:1787388216.005240:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a432f7400/0x26817551a4475720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475719 expref: 19 pid: 17089 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388216.005250:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787388216.005257:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:3649:x1874211945760384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388216.005268:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388216.005273:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b52f4ea00/0x26817551a447565c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475655 expref: 19 pid: 17088 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.005282:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b52f4ea00/0x26817551a447565c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4475655 expref: 19 pid: 17088 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.005296:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b52f4ea00/0x26817551a447565c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4475655 expref: 19 pid: 17088 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.005308:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388216.010840:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:3649:x1874211945760384:12345-0@lo:103:ldlm_bl.0 Request processed in 5576us (6872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388216.010853:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787388216.010883:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787388216.010895:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:3652:x1874211945760256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388216.010911:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388216.010919:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a432f7400/0x26817551a4475720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475719 expref: 17 pid: 17089 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.010934:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a432f7400/0x26817551a4475720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4475719 expref: 17 pid: 17089 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.010963:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a432f7400/0x26817551a4475720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4475719 expref: 17 pid: 17089 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.010976:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.010983:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787388216.010998:0:17080:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010244960s 00010000:00010000:0.0:1787388216.011001:0:17080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.011008:0:17080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.011015:0:17080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.011021:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.011027:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388216.011031:0:17080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.011037:0:17080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.011055:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.011071:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388216.011122:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+16:3652:x1874211945760256:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (7051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388216.011129:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787388216.011143:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945760256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388216.011151:0:17110:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.011157:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388216.011163:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b52f4e600/0x26817551a4475758 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388216.013473:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945760384:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1787388216.014091:0:17826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1787388216.014370:0:17851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787388216.014852:0:17851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787388216.016789:0:17826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1787388216.017963:0:17851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787388216.018038:0:17851:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000020:00080000:0.0:1787388216.018192:0:17850:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787388216.018197:0:17850:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787388216.018894:0:17852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17852:1874211945760512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787388216.018968:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388216.019004:0:17852:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388216.019303:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945760512 00000100:00100000:0.0:1787388216.019311:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945760512 00000100:00100000:0.0:1787388216.019386:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787388216.019395:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17852:x1874211945760512:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787388216.019480:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17852:x1874211945760512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 85us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388216.019487:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787388216.019625:0:17852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17852:1874211945760512:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787388216.019654:0:17852:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787388216.019681:0:17852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17852:1874211945760640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787388216.019728:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388216.019751:0:17852:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47d713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388216.019845:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945760640 00000100:00100000:0.0:1787388216.019849:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945760640 00000100:00100000:0.0:1787388216.019868:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787388216.019873:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17852:x1874211945760640:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787388216.019971:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17852:x1874211945760640:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388216.019987:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787388216.020041:0:17852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17852:1874211945760640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787388216.020091:0:17852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17852:1874211945760768:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787388216.020117:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388216.020148:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945760768 00000100:00100000:2.0:1787388216.020152:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945760768 00000100:00100000:2.0:1787388216.020195:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787388216.020203:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17852:x1874211945760768:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787388216.020236:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17852:x1874211945760768:12345-0@lo:900:lod0001_rec0000.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388216.020243:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787388216.020258:0:17852:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47d71540 going to sleep for 11 seconds 00010000:00080000:2.0:1787388216.020272:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996b7f5e2300 x1874211945760768/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787388232 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388216.020282:0:17852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17852:1874211945760768:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787388216.020314:0:17852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17852:1874211945760896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787388216.020373:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388216.020409:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945760896 00000100:00100000:2.0:1787388216.020413:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945760896 00000100:00100000:2.0:1787388216.020430:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388216.020436:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17852:x1874211945760896:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787388216.020478:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17852:x1874211945760896:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388216.020484:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388216.020498:0:17852:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b47d713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388216.020509:0:17852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17852:1874211945760896:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787388216.020547:0:17852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787388216.023691:0:17826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787388216.023868:0:17852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787388216.023937:0:17852:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787388216.023942:0:17852:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1787388216.024088:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787388216.024786:0:17826:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787388216.024798:0:17826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787388216.024844:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787388216.025847:0:17826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787388216.026393:0:17826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787388216.026420:0:17826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787388216.026581:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787388216.027012:0:17826:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1787388216.029028:0:17826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787388216.034232:0:17826:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787388216.034275:0:17826:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa5d540d17988 00100000:10000000:3.0:1787388216.034284:0:17826:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787388216.036867:0:17826:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787388216.036902:0:17826:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787388216.036919:0:17826:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787388216.036948:0:17826:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787388216.037769:0:17826:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787388216.037982:0:17826:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787388216.300684:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388217.006600:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00000040:00080000:0.0:1787388217.012085:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787388217.260681:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787388217.260687:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b73a8a800 from 8 10000000:01000000:3.0:1787388217.260692:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787388217.260738:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388217.260750:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388217.260760:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388217.260785:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945761024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787388217.260847:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388217.260930:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b461dee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388217.261133:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945761024 00000100:00100000:2.0:1787388217.261140:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945761024 00000100:00100000:2.0:1787388217.261195:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787388217.261204:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+16:17091:x1874211945761024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388217.261216:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388217.261230:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f5cc00/0x26817551a4475766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447575f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388217.261251:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f5cc00/0x26817551a4475766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447575f expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388217.261261:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f5cc00/0x26817551a4475766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447575f expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388217.261286:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5cc00, rc 0) 00000100:00100000:2.0:1787388217.261333:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17091:x1874211945761024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388217.261340:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787388217.261484:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945761024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388217.261498:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388217.261506:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388217.261550:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945761152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787388217.261588:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388217.261615:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b461dee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388217.261663:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945761152 00000100:00100000:1.0:1787388217.261668:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945761152 00000100:00100000:1.0:1787388217.261709:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787388217.261716:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17091:x1874211945761152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787388217.261730:0:17088:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787388217.261745:0:17088:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787388217.261748:0:17088:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787388217.261830:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17091:x1874211945761152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388217.261837:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787388217.262070:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945761152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787388217.262112:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787388217.262119:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388217.262127:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388217.262136:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787388217.262138:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996a44056800 from 8 10000000:01000000:3.0:1787388217.262140:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787388217.262273:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388217.262280:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388217.262288:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388217.262301:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945761280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787388217.262327:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388217.262372:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b461dee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388217.262419:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945761280 00000100:00100000:1.0:1787388217.262424:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945761280 00000100:00100000:1.0:1787388217.262454:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787388217.262461:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17091:x1874211945761280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388217.262468:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388217.262477:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f4fa00/0x26817551a4475774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447576d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388217.262493:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f4fa00/0x26817551a4475774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447576d expref: 18 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388217.262501:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f4fa00/0x26817551a4475774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447576d expref: 18 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388217.262508:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4fa00, rc 0) 00000100:00100000:1.0:1787388217.262545:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17091:x1874211945761280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388217.262551:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787388217.262615:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945761280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388217.262625:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388217.262633:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388217.262677:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945761408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787388217.262701:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388217.262722:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388217.262958:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945761408 00000100:00100000:1.0:1787388217.262962:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945761408 00000100:00100000:1.0:1787388217.262991:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787388217.263003:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17091:x1874211945761408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787388217.263014:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787388217.263024:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787388217.263027:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787388217.263097:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17091:x1874211945761408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388217.263103:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787388217.263181:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945761408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787388217.263220:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787388217.263226:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388217.263234:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388217.324679:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388218.030993:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00000040:00080000:2.0:1787388218.031734:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787388218.350279:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388219.052420:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787388219.381069:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388220.077216:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00000001:02000400:0.0:1787388220.300230:0:18094:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787388220.398517:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388221.100535:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 0 seconds 00000100:00080000:3.0:1787388221.164642:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787388221.164648:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787388221.164664:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388221.164677:0:16499:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff996b5ddf4800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388221.164699:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ae680 x1874211945761792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388221.164722:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388221.164726:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388221.164729:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388221.164731:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388221.164747:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388221.164750:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388221.164752:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388221.164755:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787388221.164789:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945761920:0@lo:400:kworker.0 00000100:00100000:3.0:1787388221.164850:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388221.164902:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388221.164907:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945761664:0@lo:400:kworker.0 00000100:00100000:3.0:1787388221.164935:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388221.164972:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945761920 00000100:00100000:3.0:1787388221.164979:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945761920 00000100:00100000:3.0:1787388221.165025:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787388221.165033:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945761920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388221.165093:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945761920:12345-0@lo:400:kworker.0 Request processed in 60us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388221.165109:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787388221.165141:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945761664 00000100:00100000:3.0:1787388221.165145:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945761664 00000100:00100000:3.0:1787388221.165170:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787388221.165177:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:3652:x1874211945761664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388221.165205:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:3652:x1874211945761664:12345-0@lo:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388221.165212:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787388221.165254:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945761664:0@lo:400:kworker.0 00010000:00080000:3.0:1787388221.165266:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b412af100 x1874211945761920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388221.165275:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945761920:0@lo:400:kworker.0 00000100:00100000:1.0:1787388221.165485:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945761536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388221.165518:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388221.165534:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945762176:0@lo:400:kworker.0 00000100:00100000:1.0:1787388221.165552:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388221.165573:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388221.165578:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945762048:0@lo:400:kworker.0 00000100:00100000:1.0:1787388221.165595:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388221.165632:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945761536 00000100:00100000:1.0:1787388221.165636:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945761536 00000100:00100000:1.0:1787388221.165654:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945762048 00000100:00100000:1.0:1787388221.165657:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945762048 00000100:00100000:1.0:1787388221.165669:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787388221.165675:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874211945761536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388221.165699:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787388221.165735:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874211945761536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388221.165740:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787388221.165762:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388221.165768:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945762048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388221.165796:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945762048:12345-0@lo:400:kworker.0 Request processed in 28us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388221.165802:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388221.165825:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945762048:0@lo:400:kworker.0 00000100:00100000:1.0:1787388221.165838:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945761536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388221.166016:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945762176 00000100:00100000:3.0:1787388221.166020:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945762176 00000100:00100000:3.0:1787388221.166048:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787388221.166066:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945762176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388221.166110:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945762176:12345-0@lo:400:kworker.0 Request processed in 56us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388221.166117:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787388221.166284:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b412aed80 x1874211945762176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388221.166294:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945762176:0@lo:400:kworker.0 00000100:00100000:1.0:1787388221.166414:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945761792:0@lo:38:kworker.0 00000100:00100000:1.0:1787388221.166443:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388221.166515:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945761792 00000100:00100000:2.0:1787388221.166520:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945761792 00000100:00100000:2.0:1787388221.166548:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787388221.166553:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1874211945761792:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787388221.166575:0:17099:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1787388221.166603:0:17099:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a447577b 00000004:00100000:2.0:1787388221.166615:0:17099:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787388221.166620:0:17099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787388221.171569:0:17099:0:(import.c:65:import_set_state_nolock()) ffff996b7b0bb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388221.171665:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874211945761792:12345-0@lo:38:kworker.0 Request processed in 5109us (5219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388221.171676:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787388221.174401:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787388221.174419:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787388221.174427:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787388221.174431:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5ddf4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787388221.174462:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000202b8b00): req@ffff996b412ac000 x1874211945754752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388221.174513:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945761792:0@lo:38:kworker.0 00000100:00100000:3.0:1787388221.174565:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945762304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388221.174624:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388221.174695:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945762304 00000100:00100000:0.0:1787388221.174702:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945762304 00000100:00100000:1.0:1787388221.174752:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388221.174764:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945754752 00000100:00100000:1.0:1787388221.174765:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388221.174769:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945754752 00000100:00100000:0.0:1787388221.174790:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787388221.174798:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3651:x1874211945762304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388221.174825:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787388221.174881:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3651:x1874211945762304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388221.174889:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787388221.174904:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787388221.174917:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17136:x1874211945754752:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787388221.174944:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945762304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388221.174994:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17136:x1874211945754752:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388221.175002:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787388221.175038:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17136:1874211945754752:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787388221.175070:0:17136:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787388221.175104:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17136:1874211945762432:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787388221.175148:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388221.175181:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72bc8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388221.177147:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945762432 00000100:00100000:0.0:1787388221.177161:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945762432 00000100:00100000:0.0:1787388221.177210:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787388221.177219:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17136:x1874211945762432:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787388221.177407:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17136:x1874211945762432:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 189us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388221.177415:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787388221.177559:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17136:1874211945762432:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787388221.177659:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17136:1874211945762560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787388221.177691:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388221.177734:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72bc8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388221.177772:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945762560 00000100:00100000:3.0:1787388221.177778:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945762560 00000100:00100000:3.0:1787388221.177817:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787388221.177825:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17136:x1874211945762560:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787388221.177883:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17136:x1874211945762560:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388221.177889:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787388221.177916:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17136:1874211945762560:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787388221.177959:0:17136:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787388221.179758:0:17136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787388221.179834:0:17136:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:3.0:1787388221.179839:0:17136:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1787388221.330438:0:18147:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787388221.330657:0:18147:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787388221.420527:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388222.446879:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787388222.512631:0:18197:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388222.512839:0:18197:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1787388223.084897:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787388223.468491:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787388223.658760:0:18245:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffcc883d200 00000020:00000080:1.0:1787388223.658788:0:18245:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787388223.658792:0:18245:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787388223.658800:0:18245:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc883f490 20000000:00000080:1.0:1787388223.658807:0:18245:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996b7b0b4c00 uarg=0000000000000000 20000000:01000000:1.0:1787388223.658846:0:18245:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787388223.658853:0:18245:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787388223.658858:0:18245:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787388223.659678:0:18246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1787388223.659818:0:18245:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787388223.678024:0:18245:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787388223.678744:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388223.678765:0:18245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a432f6c00/0x26817551a447562b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475624 expref: 17 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388223.678773:0:18245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b52f5c600/0x26817551a447572e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475727 expref: 17 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388223.678782:0:18245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388223.678825:0:18245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b52f5c600/0x26817551a447572e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4475727 expref: 17 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388223.678839:0:18245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b52f5c600/0x26817551a447572e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4475727 expref: 17 pid: 17088 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388223.678866:0:18245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18245:1874211945762688:0@lo:104: 00000100:00100000:0.0:1787388223.678929:0:18245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787388223.678982:0:18245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a432f6c00/0x26817551a447562b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4475624 expref: 17 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388223.678990:0:18245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a432f6c00/0x26817551a447562b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4475624 expref: 17 pid: 17087 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388223.679000:0:18245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18245:1874211945762816:0@lo:104: 00000100:00100000:0.0:1787388223.679021:0:18245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388223.679035:0:18245:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b455ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1787388223.679120:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945762688 00000100:00100000:3.0:1787388223.679128:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945762688 00000100:00100000:3.0:1787388223.679163:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945762816 00000100:00100000:3.0:1787388223.679165:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945762816 00000100:00100000:3.0:1787388223.679179:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787388223.679188:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+4:18245:x1874211945762688:12345-0@lo:104: 00010000:00010000:3.0:1787388223.679199:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679267:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787388223.679274:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+4:18245:x1874211945762688:12345-0@lo:104: Request processed in 87us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388223.679281:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787388223.679307:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787388223.679314:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:18245:x1874211945762816:12345-0@lo:104: 00010000:00010000:3.0:1787388223.679321:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679379:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787388223.679385:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:18245:x1874211945762816:12345-0@lo:104: Request processed in 72us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388223.679390:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787388223.679406:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787388223.679412:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679419:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f800 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787388223.679422:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679430:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388223.679437:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388223.679443:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787388223.679474:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679481:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388223.679499:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679505:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475727 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447572e expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679517:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388223.679520:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679526:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4e200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787388223.679529:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679535:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388223.679542:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388223.679548:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787388223.679558:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679563:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388223.679572:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679588:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a4475624 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447562b expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679600:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388223.679602:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388223.679603:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388223.679614:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945762944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388223.679651:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388223.679682:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945762944 00000100:00100000:3.0:1787388223.679685:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945762944 00010000:00010000:3.0:1787388223.679700:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b52f5c600/0x26817551a447572e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475727 expref: 18 pid: 17088 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388223.679719:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787388223.679725:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:3652:x1874211945762944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388223.679734:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388223.679739:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b52f5c600/0x26817551a447572e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475727 expref: 18 pid: 17088 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679747:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b52f5c600/0x26817551a447572e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4475727 expref: 18 pid: 17088 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.679761:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388223.679785:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:3652:x1874211945762944:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388223.679791:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787388223.679823:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945762944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388223.680005:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388223.680026:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945763072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787388223.680051:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388223.680174:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945763072 00000100:00100000:3.0:1787388223.680178:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945763072 00010000:00010000:3.0:1787388223.680192:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a432f6c00/0x26817551a447562b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475624 expref: 18 pid: 17087 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388223.680216:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787388223.680222:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:3649:x1874211945763072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787388223.680229:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388223.680233:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a432f6c00/0x26817551a447562b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475624 expref: 18 pid: 17087 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680241:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a432f6c00/0x26817551a447562b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4475624 expref: 18 pid: 17087 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680253:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680261:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680273:0:17081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680289:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680295:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680301:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680317:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388223.680321:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680328:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680336:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388223.680367:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388223.680393:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:3649:x1874211945763072:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388223.680400:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787388223.680518:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945763072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787388223.681190:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b52f5c600/0x26817551a447572e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4475727 expref: 17 pid: 17088 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388223.681203:0:18245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18245:1874211945762688:0@lo:104: 00010000:00010000:0.0:1787388223.681213:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a432f6c00/0x26817551a447562b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4475624 expref: 16 pid: 17087 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388223.681220:0:18245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18245:1874211945762816:0@lo:104: 00010000:00010000:0.0:1787388223.681234:0:18245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388223.681242:0:18245:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388223.681248:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388223.681268:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40031400/0x26817551a4475782 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388224.493476:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388225.262580:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388215/real 1787388215] req@ffff996b412ad180 x1874211945757952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388225.262610:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b412ad180 x1874211945757952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388225.262621:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388215/real 1787388215] req@ffff996b7f5e1500 x1874211945757824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388225.262634:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b7f5e1500 x1874211945757824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787388225.262653:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a43023800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388225.262664:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787388225.262678:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945757952:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787388225.262684:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a423b5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388225.262689:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787388225.262692:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945757824:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787388225.264052:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388225.264058:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388225.264060:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388225.264063:0:16499:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388225.264078:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388225.264081:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787388225.264085:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996a423b5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388225.264093:0:16499:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1787388225.264098:0:16499:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787388225.264113:0:16499:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff996a423b5800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388225.264132:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ad880 x1874211945763712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388225.264154:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388225.264157:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787388225.264159:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996a43023800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787388225.264163:0:16499:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1787388225.264165:0:16499:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787388225.264170:0:16499:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff996a43023800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388225.264183:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b412ac000 x1874211945763840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787388225.264216:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945763456:0@lo:400:kworker.0 00000100:00100000:3.0:1787388225.264288:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388225.264322:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388225.264328:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945763328:0@lo:400:kworker.0 00000100:00100000:3.0:1787388225.264367:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388225.264402:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945763456 00000100:00100000:3.0:1787388225.264408:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945763456 00000100:00100000:3.0:1787388225.264446:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787388225.264453:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945763456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388225.264495:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945763456:12345-0@lo:400:kworker.0 Request processed in 42us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388225.264502:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787388225.264519:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945763328 00000100:00100000:3.0:1787388225.264522:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945763328 00000100:00100000:3.0:1787388225.264542:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787388225.264548:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874211945763328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388225.264576:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874211945763328:12345-0@lo:400:kworker.0 Request processed in 28us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388225.264588:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787388225.264623:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945763328:0@lo:400:kworker.0 00010000:00080000:3.0:1787388225.264633:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b412ac380 x1874211945763456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388225.264642:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945763456:0@lo:400:kworker.0 00000100:00100000:1.0:1787388225.264837:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945763200:0@lo:400:kworker.0 00000100:00100000:1.0:1787388225.264870:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388225.264906:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945763968:0@lo:400:kworker.0 00000100:00100000:1.0:1787388225.264927:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388225.264944:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787388225.264949:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945763584:0@lo:400:kworker.0 00000100:00100000:1.0:1787388225.264969:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388225.264998:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945763584 00000100:00100000:1.0:1787388225.265001:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945763584 00000100:00100000:1.0:1787388225.265019:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787388225.265025:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945763584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388225.265059:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945763584:12345-0@lo:400:kworker.0 Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388225.265065:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787388225.265081:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945763968 00000100:00100000:1.0:1787388225.265086:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945763968 00000100:00100000:1.0:1787388225.265115:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388225.265122:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945763968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388225.265150:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945763968:12345-0@lo:400:kworker.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388225.265156:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388225.265186:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945763712:0@lo:8:kworker.0 00000400:00000100:1.0:1787388225.265210:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211945763712 offset 0 length 520: 4 00000100:00100000:1.0:1787388225.265222:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945763840:0@lo:8:kworker.0 00000400:00000100:1.0:1787388225.265237:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211945763840 offset 0 length 520: 4 00000100:00100000:1.0:1787388225.265265:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945763584:0@lo:400:kworker.0 00010000:00080000:1.0:1787388225.265424:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b412aed80 x1874211945763968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388225.265434:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945763968:0@lo:400:kworker.0 00000100:00100000:3.0:1787388225.265970:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945763200 00000100:00100000:3.0:1787388225.265975:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945763200 00000100:00100000:3.0:1787388225.266014:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787388225.266021:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+16:3650:x1874211945763200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388225.266063:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+16:3650:x1874211945763200:12345-0@lo:400:kworker.0 Request processed in 42us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388225.266070:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787388225.266145:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945763200:0@lo:400:kworker.0 10000000:01000000:3.0:1787388225.330343:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787388225.330363:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b73a8a800 from 13 10000000:01000000:3.0:1787388225.330368:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787388225.330413:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388225.330425:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388225.330436:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388225.330461:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787388225.330523:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388225.330582:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4533c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787388225.331026:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945764096 00000100:00100000:2.0:1787388225.331034:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945764096 00000100:00100000:2.0:1787388225.331075:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787388225.331084:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+16:17091:x1874211945764096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388225.331096:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388225.331120:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f5d000/0x26817551a4475790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475789 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388225.331142:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f5d000/0x26817551a4475790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475789 expref: 17 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388225.331152:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f5d000/0x26817551a4475790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475789 expref: 17 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388225.331161:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5d000, rc 0) 00000100:00100000:2.0:1787388225.332460:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17091:x1874211945764096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1371us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388225.332470:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787388225.332576:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388225.332596:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388225.332608:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388225.332680:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388225.332706:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388225.332737:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388225.332899:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945764224 00000100:00100000:2.0:1787388225.332905:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945764224 00000100:00100000:2.0:1787388225.332942:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787388225.332950:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17091:x1874211945764224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388225.333069:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17091:x1874211945764224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388225.333077:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787388225.333521:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388225.333846:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388225.333892:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388225.333922:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388225.333957:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945764352 00000100:00100000:2.0:1787388225.333962:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945764352 00000100:00100000:2.0:1787388225.333998:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787388225.334005:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17091:x1874211945764352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388225.334093:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17091:x1874211945764352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388225.334100:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787388225.334538:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787388225.335789:0:18325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787388225.338836:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787388225.338930:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787388225.338942:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388225.338954:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388225.339007:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787388225.339010:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996a44056800 from 13 10000000:01000000:0.0:1787388225.339013:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787388225.339048:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388225.339057:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388225.339066:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388225.339090:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388225.339170:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388225.339207:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945764480 00000100:00100000:0.0:1787388225.339213:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945764480 00000100:00100000:0.0:1787388225.339261:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787388225.339271:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+17:17091:x1874211945764480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388225.339283:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388225.339295:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b40030000/0x26817551a447579e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475797 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388225.339317:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40030000/0x26817551a447579e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475797 expref: 18 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388225.339327:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b40030000/0x26817551a447579e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475797 expref: 18 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388225.339337:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40030000, rc 0) 00000100:00100000:0.0:1787388225.339409:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17091:x1874211945764480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388225.339417:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787388225.339456:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388225.339476:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388225.339488:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388225.339497:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388225.339559:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388225.339584:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388225.339605:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388225.339717:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945764608 00000100:00100000:3.0:1787388225.339723:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945764608 00000100:00100000:3.0:1787388225.339761:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787388225.339770:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17091:x1874211945764608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388225.339888:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17091:x1874211945764608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388225.339896:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787388225.339946:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388225.339974:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388225.340014:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388225.340038:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388225.340130:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945764736 00000100:00100000:3.0:1787388225.340135:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945764736 00000100:00100000:3.0:1787388225.340161:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787388225.340168:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17091:x1874211945764736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388225.340263:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:17091:x1874211945764736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388225.340282:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787388225.340285:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945764736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787388225.341464:0:18326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787388225.341952:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787388225.341972:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388225.341982:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388225.341994:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388225.518381:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388226.286582:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388211/real 1787388211] req@ffff996b738ead80 x1874211945756032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388226 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388226.286607:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b738ead80 x1874211945756032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388226 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388226.286618:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388211/real 1787388211] req@ffff996b738eb480 x1874211945755904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388226 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388226.286628:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b738eb480 x1874211945755904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388226 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787388226.286644:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5ddfe000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388226.286652:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787388226.286656:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945756032:0@lo:8:kworker.0 00000100:00080000:1.0:1787388226.286661:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a42fcb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388226.286665:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787388226.286677:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945755904:0@lo:8:kworker.0 00000100:00100000:1.0:1787388226.286707:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945764864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388226.286763:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388226.286799:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945764864 00000100:00100000:1.0:1787388226.286806:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945764864 00000100:00100000:1.0:1787388226.286843:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787388226.286851:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945764864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388226.286882:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787388226.286920:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945764864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388226.286926:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787388226.286963:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945764864:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787388226.287250:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388226.287254:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787388226.287257:0:36:0:(import.c:65:import_set_state_nolock()) ffff996b5ddfe000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787388226.287260:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:0.0:1787388226.287275:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787388226.287288:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff996b5ddfe000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1787388226.287306:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b738e9500 x1874211945765248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787388226.287337:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388226.287340:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787388226.287341:0:36:0:(import.c:65:import_set_state_nolock()) ffff996a42fcb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787388226.287368:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:0.0:1787388226.287371:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787388226.287374:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff996a42fcb800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1787388226.287385:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b738e8000 x1874211945765376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787388226.287401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388226.287404:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787388226.287406:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388226.287409:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787388226.287487:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945765120:0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.287519:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388226.287550:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388226.287556:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945765504:0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.287579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388226.287606:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945765120 00000100:00100000:0.0:1787388226.287610:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945765120 00000100:00100000:0.0:1787388226.287635:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787388226.287641:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945765120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.287691:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945765120:12345-0@lo:400:kworker.0 Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388226.287698:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787388226.287716:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945765504 00000100:00100000:0.0:1787388226.287719:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945765504 00000100:00100000:0.0:1787388226.287742:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787388226.287748:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945765504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.287774:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945765504:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388226.287781:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787388226.287810:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b738e9180 x1874211945765504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388226.287819:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945765504:0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.287829:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945765120:0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.287847:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945765632:0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.287871:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388226.287887:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388226.287893:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3651:1874211945764992:0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.287916:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388226.287941:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945765632 00000100:00100000:0.0:1787388226.287945:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945765632 00000100:00100000:0.0:1787388226.287965:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787388226.287970:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945765632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.288003:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945765632:12345-0@lo:400:kworker.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388226.288017:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787388226.288034:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945764992 00000100:00100000:0.0:1787388226.288038:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945764992 00000100:00100000:0.0:1787388226.288060:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787388226.288066:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:3651:x1874211945764992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.288106:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:3651:x1874211945764992:12345-0@lo:400:kworker.0 Request processed in 29us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388226.288112:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787388226.288148:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3651:1874211945764992:0@lo:400:kworker.0 00010000:00080000:0.0:1787388226.288158:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b738ea300 x1874211945765632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388226.288165:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945765632:0@lo:400:kworker.0 00000100:00100000:0.0:1787388226.288198:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945765248:0@lo:8:kworker.0 00000400:00000100:0.0:1787388226.288218:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211945765248 offset 0 length 520: 4 00000100:00100000:0.0:1787388226.288231:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945765376:0@lo:8:kworker.0 00000400:00000100:0.0:1787388226.288244:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874211945765376 offset 0 length 520: 4 00000100:00100000:3.0:1787388226.289140:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945765760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388226.289191:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388226.291982:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945765760 00000100:00100000:0.0:1787388226.291996:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945765760 00000100:00100000:0.0:1787388226.292047:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787388226.292056:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874211945765760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388226.292090:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787388226.292217:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874211945765760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (3025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388226.292224:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000001:00100000:0.0:1787388226.293503:0:17827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787388226.294792:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945765760:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787388226.541652:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388227.568726:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388228.277514:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787388228.588995:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388229.612658:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787388229.772716:0:18594:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787388229.772720:0:18594:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787388229.772722:0:18594:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787388229.772830:0:18594:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff996b7b0b8800 00000020:01000004:2.0:1787388229.772845:0:18594:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787388229.772858:0:18594:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787388229.772941:0:18594:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff996b7bdf99c0) 00000020:00000080:2.0:1787388229.772957:0:18594:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787388229.823540:0:18594:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787388229.824873:0:18594:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787388229.825467:0:18594:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787388229.825807:0:18594:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787388229.826177:0:18594:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787388229.826584:0:18594:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787388229.826830:0:18594:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1787388229.829827:0:18594:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787388229.830044:0:18594:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787388229.830065:0:18594:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787388229.830085:0:18594:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26817551a44757ac 00000020:01000004:2.0:1787388229.830100:0:18594:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787388229.830121:0:18594:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787388229.830125:0:18594:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787388229.830131:0:18594:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787388229.830135:0:18594:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787388229.830147:0:18594:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff996b7bdfb380) 00000020:00000080:2.0:1787388229.830158:0:18594:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787388229.831289:0:18594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787388229.831474:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787388229.831480:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787388229.842941:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787388229.842954:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787388229.847385:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787388229.847404:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787388229.851704:0:18594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787388229.852029:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787388229.852036:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787388229.858267:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787388229.858286:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787388229.892927:0:18594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787388229.893143:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787388229.893265:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787388229.895116:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787388229.895127:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787388229.896752:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787388229.896764:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787388229.899682:0:18594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787388229.899854:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787388229.899861:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787388229.900762:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787388229.900771:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787388229.946899:0:18594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787388229.947151:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787388229.947158:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787388229.948222:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787388229.948232:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787388229.948873:0:18594:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787388229.949140:0:18594:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787388229.949146:0:18594:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787388229.963533:0:18594:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787388229.963574:0:18594:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.115@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787388229.963580:0:18594:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787388229.963582:0:18594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787388229.963583:0:18594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388229.963584:0:18594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388229.963585:0:18594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388229.963586:0:18594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388229.963588:0:18594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787388229.963590:0:18594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388229.963591:0:18594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787388229.963598:0:18594:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787388229.963601:0:18594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787388229.963602:0:18594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787388229.963603:0:18594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388229.963604:0:18594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388229.963605:0:18594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388229.963606:0:18594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388229.963607:0:18594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787388229.963608:0:18594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388229.963609:0:18594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787388229.963635:0:18594:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787388229.963655:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945765888:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787388229.963736:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388229.963840:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d55000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388229.963880:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945765888 00000100:00100000:3.0:1787388229.963887:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945765888 00000100:00100000:3.0:1787388229.963984:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787388229.963994:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:18594:x1874211945765888:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787388229.964024:0:17088:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787388229.964027:0:17088:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787388229.964031:0:17088:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787388229.968644:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:18594:x1874211945765888:12345-0@lo:253:mount.lustre.0 Request processed in 4643us (4899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388229.968659:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787388229.968771:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945765888:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787388229.968785:0:18594:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787388229.968788:0:18594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787388229.968790:0:18594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787388229.968791:0:18594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388229.968792:0:18594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388229.968793:0:18594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388229.968794:0:18594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388229.968796:0:18594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787388229.968797:0:18594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388229.968799:0:18594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787388229.968819:0:18594:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996b7b0b8800 from lustre-OST0000 10000000:01000000:2.0:1787388229.968870:0:18594:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787388229.968873:0:18594:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787388229.968880:0:18594:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff996b72b80000 local copy 00010000:00010000:2.0:1787388229.968891:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388229.968991:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388229.969035:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388229.969641:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388229.969728:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945766016 00000100:00100000:0.0:1787388229.969736:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945766016 00000100:00100000:0.0:1787388229.969772:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787388229.969781:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:18594:x1874211945766016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388229.969878:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:18594:x1874211945766016:12345-0@lo:501:mount.lustre.0 Request processed in 98us (842us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787388229.969885:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787388229.969971:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766016:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787388229.969986:0:18594:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787388229.970017:0:18594:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787388229.970024:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388229.970033:0:18594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388229.970077:0:18594:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996b7b0b8800 10000000:01000000:2.0:1787388229.970082:0:18594:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787388229.970087:0:18594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787388229.970097:0:18594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787388229.970101:0:18594:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787388229.970103:0:18594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787388229.970126:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5d600/0x26817551a44757ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388229.970134:0:18594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f5d600/0x26817551a44757ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388229.970143:0:18594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f5d600/0x26817551a44757ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388229.970175:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388229.970203:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388229.970227:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388229.970772:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945766144 00000100:00100000:0.0:1787388229.970778:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945766144 00000100:00100000:0.0:1787388229.970803:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787388229.970809:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+18:18594:x1874211945766144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388229.970818:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388229.970831:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b40031000/0x26817551a44757c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44757ba expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388229.970854:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40031000/0x26817551a44757c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44757ba expref: 19 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388229.970864:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b40031000/0x26817551a44757c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44757ba expref: 19 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388229.970887:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031000, rc 0) 00000100:00100000:0.0:1787388229.970937:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:18594:x1874211945766144:12345-0@lo:101:mount.lustre.0 Request processed in 127us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388229.970944:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787388229.971035:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388229.971060:0:18594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f5d600/0x26817551a44757ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44757c1 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388229.971085:0:18594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f5d600/0x26817551a44757ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44757c1 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388229.974382:0:18594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787388229.976296:0:18594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787388229.979985:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787388229.980038:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787388229.980079:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787388229.982596:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787388229.982636:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787388229.982674:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787388229.982705:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787388229.982710:0:18594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787388229.982810:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388229.982897:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388229.982931:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787388229.983099:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945766272 00000100:00100000:0.0:1787388229.983107:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945766272 00000100:00100000:0.0:1787388229.983158:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787388229.983167:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:18594:x1874211945766272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388229.983329:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:18594:x1874211945766272:12345-0@lo:501:mount.lustre.0 Request processed in 163us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388229.983337:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787388229.983994:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388229.984037:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787388229.984106:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388229.984141:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388229.984236:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945766400 00000100:00100000:1.0:1787388229.984242:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945766400 00000100:00100000:1.0:1787388229.984315:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787388229.984324:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:18594:x1874211945766400:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388229.986293:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:18594:x1874211945766400:12345-0@lo:503:mount.lustre.0 Request processed in 1963us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388229.986306:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787388229.986447:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787388229.986858:0:18594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787388229.986962:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388229.987010:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388229.987046:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388229.987100:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945766528 00000100:00100000:0.0:1787388229.987108:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945766528 00000100:00100000:0.0:1787388229.987154:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787388229.987163:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:18594:x1874211945766528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388229.987968:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:18594:x1874211945766528:12345-0@lo:502:mount.lustre.0 Request processed in 803us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388229.987977:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787388229.988097:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388229.988289:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787388229.988326:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787388229.988381:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787388229.988408:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787388229.988426:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787388229.988439:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787388229.988457:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787388229.988473:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787388229.988488:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787388229.988504:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787388229.988520:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787388229.988535:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787388229.988583:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388229.988627:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388229.988655:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787388229.988938:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945766656 00000100:00100000:1.0:1787388229.988945:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945766656 00000100:00100000:1.0:1787388229.988984:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787388229.988993:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:18594:x1874211945766656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388229.989130:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:18594:x1874211945766656:12345-0@lo:502:mount.lustre.0 Request processed in 136us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388229.989137:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787388229.989820:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388229.989941:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787388229.989953:0:18594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787388229.991974:0:18611:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787388229.991992:0:18611:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787388229.991999:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388229.992008:0:18611:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787388229.992015:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388229.992030:0:18611:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff996b48344d40) 00000020:00000080:1.0:1787388229.992052:0:18611:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787388229.992058:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787388229.992266:0:18611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b7b0b8800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787388229.992274:0:18611:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787388229.992280:0:18611:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26817551a44757cf 00010000:00010000:1.0:1787388229.997425:0:18611:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787388229.998523:0:18611:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1787388230.000639:0:18611:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787388230.005450:0:18611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787388230.005467:0:18611:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388230.005473:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388230.005475:0:18611:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787388230.005478:0:18611:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787388230.005481:0:18611:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787388230.005482:0:18611:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388230.005484:0:18611:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787388230.005485:0:18611:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787388230.005488:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388230.005489:0:18611:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787388230.005491:0:18611:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388230.005494:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388230.005495:0:18611:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787388230.005498:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787388230.005500:0:18611:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787388230.005502:0:18611:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388230.005503:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388230.005504:0:18611:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787388230.005507:0:18611:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388230.005509:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388230.005509:0:18611:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787388230.005512:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787388230.005550:0:18611:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388230.005553:0:18611:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388230.005554:0:18611:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787388230.005557:0:18611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787388230.005731:0:18594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787388230.005761:0:18594:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787388230.005774:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5d600/0x26817551a44757ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44757c1 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388230.005793:0:18594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5d600/0x26817551a44757ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44757c1 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388230.005801:0:18594:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b7b0b8800 from 1 10000000:01000000:2.0:1787388230.005804:0:18594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388230.005836:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388230.005843:0:18594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388230.005853:0:18594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388230.005876:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388230.005939:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388230.005974:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787388230.006399:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945766784 00000100:00100000:1.0:1787388230.006407:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945766784 00000100:00100000:1.0:1787388230.006698:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787388230.006709:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:18594:x1874211945766784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388230.006722:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388230.006735:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f4ea00/0x26817551a44757dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44757d6 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.006757:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f4ea00/0x26817551a44757dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44757d6 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.006767:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f4ea00/0x26817551a44757dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44757d6 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.006775:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f4ea00, rc 0) 00000100:00100000:1.0:1787388230.006816:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:18594:x1874211945766784:12345-0@lo:101:mount.lustre.0 Request processed in 110us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388230.006823:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787388230.006902:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388230.006917:0:18594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388230.006926:0:18594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388230.015083:0:18594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787388230.015399:0:18594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787388230.015571:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787388230.015597:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787388230.015618:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787388230.015623:0:18594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787388230.015696:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388230.015757:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388230.015804:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d553c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388230.015967:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945766912 00000100:00100000:0.0:1787388230.015974:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945766912 00000100:00100000:0.0:1787388230.016013:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787388230.016021:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:18594:x1874211945766912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388230.016149:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:18594:x1874211945766912:12345-0@lo:501:mount.lustre.0 Request processed in 127us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388230.016156:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787388230.017371:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945766912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388230.017415:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388230.017469:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388230.017498:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d553c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388230.021856:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945767040 00000100:00100000:0.0:1787388230.021871:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945767040 00000100:00100000:0.0:1787388230.021935:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787388230.021944:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:18594:x1874211945767040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388230.022116:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:18594:x1874211945767040:12345-0@lo:503:mount.lustre.0 Request processed in 172us (4646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388230.022123:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787388230.022704:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767040:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787388230.023229:0:18594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787388230.023430:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388230.023491:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388230.023563:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d55300 going to sleep for 11 seconds 00000100:00100000:0.0:1787388230.023734:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945767168 00000100:00100000:0.0:1787388230.023740:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945767168 00000100:00100000:0.0:1787388230.023804:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787388230.023813:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b58389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:18594:x1874211945767168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388230.023923:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b58389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:18594:x1874211945767168:12345-0@lo:502:mount.lustre.0 Request processed in 111us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388230.023931:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787388230.024003:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787388230.024207:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787388230.024231:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787388230.024254:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787388230.024279:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787388230.024298:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787388230.024310:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787388230.024321:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787388230.024332:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787388230.024342:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787388230.024385:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787388230.024398:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787388230.024420:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388230.024461:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388230.024897:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b461de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388230.024965:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945767296 00000100:00100000:1.0:1787388230.024970:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945767296 00000100:00100000:1.0:1787388230.024998:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787388230.025005:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:18594:x1874211945767296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388230.025166:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:18594:x1874211945767296:12345-0@lo:502:mount.lustre.0 Request processed in 161us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388230.025173:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787388230.025315:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787388230.025386:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787388230.025395:0:18594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787388230.031294:0:18615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388230.031308:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388230.031310:0:18615:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787388230.031318:0:18615:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b7b0b8800 00000020:00000080:0.0:1787388230.031321:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388230.031329:0:18615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388230.031332:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388230.031333:0:18615:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787388230.031336:0:18615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388230.031338:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388230.031339:0:18615:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787388230.031342:0:18615:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996b7b0b8800 00000020:00000080:0.0:1787388230.031366:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388230.031448:0:18615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388230.031453:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388230.031454:0:18615:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787388230.031470:0:18615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388230.031473:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388230.031474:0:18615:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787388230.031478:0:18615:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b7b0b8800 00000020:00000080:0.0:1787388230.031480:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388230.031501:0:18615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388230.031504:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388230.031505:0:18615:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787388230.031508:0:18615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787388230.031510:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388230.031511:0:18615:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787388230.031515:0:18615:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996b7b0b8800 00000020:00000080:0.0:1787388230.031517:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787388230.031541:0:18615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787388230.031544:0:18615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787388230.031546:0:18615:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787388230.031549:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1787388230.031654:0:18594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787388230.031682:0:18594:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787388230.031705:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.031716:0:18594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388230.031778:0:18594:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787388230.031781:0:18594:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996b7b0b8800 10000000:01000000:1.0:1787388230.031789:0:18594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996b7b0b8800 10000000:01000000:1.0:1787388230.031793:0:18594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787388230.031799:0:18594:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996b7b0b8800 from 1 10000000:01000000:1.0:1787388230.031802:0:18594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787388230.031837:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a44757e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.031846:0:18594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a44757e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.031857:0:18594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a44757e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388230.031882:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388230.031944:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388230.031986:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d55000 going to sleep for 11 seconds 00000100:00100000:0.0:1787388230.035339:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945767424 00000100:00100000:0.0:1787388230.035365:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945767424 00000100:00100000:0.0:1787388230.042330:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787388230.042361:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:18594:x1874211945767424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388230.043537:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388230.043561:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b40031e00/0x26817551a44757eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a44757e4 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388230.043592:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40031e00/0x26817551a44757eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a44757e4 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388230.043617:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b40031e00/0x26817551a44757eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44757e4 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388230.043633:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031e00, rc 0) 00000100:00100000:0.0:1787388230.043721:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945767424:12345-0@lo:101:mount.lustre.0 Request processed in 1379us (11776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388230.043729:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787388230.045488:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388230.045511:0:18594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a44757e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44757eb expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388230.045523:0:18594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a44757e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a44757eb expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388230.047757:0:18594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787388230.048033:0:18594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787388230.048236:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787388230.048263:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787388230.048290:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787388230.048305:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787388230.048318:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787388230.048331:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787388230.048342:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787388230.048394:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787388230.048409:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787388230.048423:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787388230.048437:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787388230.048450:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787388230.048464:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787388230.048476:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787388230.048488:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787388230.048499:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787388230.048511:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787388230.048522:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787388230.048534:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787388230.048546:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787388230.048558:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787388230.048570:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787388230.048582:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787388230.048595:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787388230.048607:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1787388230.048618:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1787388230.048630:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1787388230.048644:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1787388230.048655:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1787388230.048670:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1787388230.048698:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1787388230.048715:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1787388230.048728:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1787388230.048740:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1787388230.048751:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1787388230.048775:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1787388230.048790:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1787388230.048809:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1787388230.048814:0:18594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787388230.048896:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388230.048957:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388230.049004:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787388230.052296:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945767552 00000100:00100000:0.0:1787388230.052310:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945767552 00000100:00100000:2.0:1787388230.052451:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787388230.052463:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945767552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388230.052623:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945767552:12345-0@lo:501:mount.lustre.0 Request processed in 162us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388230.052631:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787388230.052719:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388230.052772:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787388230.052820:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388230.052850:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1787388230.053532:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945767680 00000100:00100000:2.0:1787388230.053539:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945767680 00000100:00100000:2.0:1787388230.053574:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787388230.053582:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945767680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787388230.053874:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945767680:12345-0@lo:503:mount.lustre.0 Request processed in 292us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388230.053882:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787388230.053946:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767680:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787388230.054690:0:18594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787388230.054799:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388230.054854:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388230.054883:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1787388230.054899:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945767808 00000100:00100000:2.0:1787388230.054904:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945767808 00000100:00100000:2.0:1787388230.054945:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787388230.054953:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945767808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388230.055048:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945767808:12345-0@lo:502:mount.lustre.0 Request processed in 95us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388230.055056:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787388230.055112:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388230.055390:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787388230.055411:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787388230.055421:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787388230.055429:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787388230.055442:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787388230.055459:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787388230.055475:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787388230.055505:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787388230.055518:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787388230.055528:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787388230.055539:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787388230.055547:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787388230.055554:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787388230.055562:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787388230.055571:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787388230.055577:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787388230.055583:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787388230.055590:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787388230.055605:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787388230.055612:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787388230.055620:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787388230.055630:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787388230.055641:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787388230.055669:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787388230.055689:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787388230.055704:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787388230.055721:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787388230.055739:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787388230.055758:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787388230.055778:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787388230.055874:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787388230.055897:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787388230.055912:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787388230.055943:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787388230.055962:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787388230.055991:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787388230.056015:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787388230.056034:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787388230.056053:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787388230.056099:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787388230.056122:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787388230.056142:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787388230.056161:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787388230.056182:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787388230.056201:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787388230.056228:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787388230.056250:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787388230.056269:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787388230.056323:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388230.056441:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388230.056478:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945767936 00000100:00100000:0.0:1787388230.056486:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945767936 00000100:00100000:2.0:1787388230.056487:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787388230.056535:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787388230.056547:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945767936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388230.056662:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945767936:12345-0@lo:502:mount.lustre.0 Request processed in 118us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388230.056670:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787388230.058755:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945767936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388230.058967:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787388230.059012:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787388230.059048:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945768064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388230.059123:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388230.059157:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945768064 00000100:00100000:2.0:1787388230.059162:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945768064 00000100:00100000:2.0:1787388230.059201:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787388230.059210:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945768064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388230.059306:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945768064:12345-0@lo:502:mount.lustre.0 Request processed in 94us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388230.059314:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787388230.059394:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b622b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1787388230.059408:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945768064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787388230.059444:0:18594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787388230.059452:0:18594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787388230.063848:0:18620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787388230.063866:0:18620:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff996b7c52b380) 00000020:00000080:0.0:1787388230.063890:0:18620:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787388230.064100:0:18620:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b7b0b8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787388230.064104:0:18620:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b7b0b8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787388230.064107:0:18620:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b7b0b8800 3 00010000:00080000:0.0:1787388230.064141:0:18620:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a42f7e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1787388230.065800:0:18620:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787388230.065898:0:18620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787388230.065945:0:18620:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787388230.065955:0:18620:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x26817551a44757f9 00000100:00080000:0.0:1787388230.065964:0:18620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787388230.065970:0:18620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff996a42f7e800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1787388230.066647:0:18620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b738ea300 x1874211945768192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388230.067299:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1874211945768192:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787388230.067412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388230.067466:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945768192 00000100:00100000:0.0:1787388230.067473:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945768192 00000100:00100000:0.0:1787388230.067504:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787388230.067511:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874211945768192:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787388230.067533:0:17095:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:0.0:1787388230.067572:0:17095:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x26817551a4475800 00000004:00100000:0.0:1787388230.067587:0:17095:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787388230.067615:0:17095:0:(import.c:65:import_set_state_nolock()) ffff996a42f7c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388230.067664:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874211945768192:12345-0@lo:38:llog_process_th.0 Request processed in 152us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388230.067672:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787388230.067711:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b738ea300 x1874211945768192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388230.067722:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787388230.067729:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787388230.067737:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787388230.067741:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787388230.067743:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a42f7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787388230.067758:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1874211945768192:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787388230.067778:0:18620:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787388230.067819:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388230.067822:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787388230.067825:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388230.067828:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787388230.067857:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388230.067860:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787388230.067862:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787388230.067865:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787388230.067890:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945768320:0@lo:400:kworker.0 00000100:00100000:0.0:1787388230.067923:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388230.067945:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388230.067950:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945768448:0@lo:400:kworker.0 00000100:00100000:0.0:1787388230.067970:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388230.068243:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945768704:0@lo:400:kworker.0 00000100:00100000:2.0:1787388230.068273:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388230.068292:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388230.068297:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945768576:0@lo:400:kworker.0 00000100:00100000:2.0:1787388230.068319:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388230.068363:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945768320 00000100:00100000:2.0:1787388230.068368:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945768320 00000100:00100000:2.0:1787388230.068392:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945768576 00000100:00100000:2.0:1787388230.068394:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945768576 00000100:00100000:2.0:1787388230.068409:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787388230.068423:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945768320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388230.068463:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945768320:12345-0@lo:400:kworker.0 Request processed in 41us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388230.068471:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787388230.068486:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787388230.068492:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945768576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388230.068523:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945768576:12345-0@lo:400:kworker.0 Request processed in 32us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388230.068529:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787388230.068556:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945768576:0@lo:400:kworker.0 00000100:00100000:2.0:1787388230.068578:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945768448 00000100:00100000:2.0:1787388230.068581:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945768448 00000100:00100000:2.0:1787388230.068604:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945768704 00000100:00100000:2.0:1787388230.068607:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945768704 00000100:00100000:2.0:1787388230.068620:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787388230.068626:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945768448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388230.068657:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945768448:12345-0@lo:400:kworker.0 Request processed in 31us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388230.068662:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787388230.068673:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388230.068679:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945768704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388230.068710:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945768704:12345-0@lo:400:kworker.0 Request processed in 31us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388230.068716:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787388230.068743:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b738eaa00 x1874211945768704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388230.068765:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945768704:0@lo:400:kworker.0 00010000:00080000:0.0:1787388230.068841:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b738e9180 x1874211945768448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388230.068851:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945768448:0@lo:400:kworker.0 00000100:00100000:0.0:1787388230.068859:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945768320:0@lo:400:kworker.0 00000020:01000004:0.0:1787388230.069326:0:18620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787388230.069340:0:18620:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff996b7c528000) 00000020:00000080:0.0:1787388230.069385:0:18620:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787388230.069539:0:18620:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996b7b0b8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787388230.069544:0:18620:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996b7b0b8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787388230.069547:0:18620:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996b7b0b8800 3 00010000:00080000:0.0:1787388230.069587:0:18620:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a420b0800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.115@tcp at head 00010000:00010000:1.0:1787388230.073828:0:18620:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1787388230.073945:0:18620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787388230.073993:0:18620:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787388230.074008:0:18620:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x26817551a447580e 00000100:00080000:1.0:1787388230.074018:0:18620:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787388230.074025:0:18620:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff996a420b0800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1787388230.074059:0:18620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f58f480 x1874211945768832/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787388230.074099:0:18620:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787388230.074133:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1874211945768832:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787388230.074216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388230.074275:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388230.074288:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388230.074291:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388230.074294:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388230.074298:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388230.074300:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388230.074303:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388230.074306:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787388230.074327:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945768832 00000100:00100000:1.0:1787388230.074333:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945768832 00000100:00100000:1.0:1787388230.074386:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787388230.074393:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874211945768832:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787388230.074418:0:17095:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:1.0:1787388230.074449:0:17095:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x26817551a4475815 00000004:00100000:1.0:1787388230.074463:0:17095:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787388230.074493:0:17095:0:(import.c:65:import_set_state_nolock()) ffff996a42cae000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787388230.074547:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874211945768832:12345-0@lo:38:llog_process_th.0 Request processed in 152us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388230.074557:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787388230.074600:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996b7f58f480 x1874211945768832/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388230.074609:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787388230.074616:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787388230.074634:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787388230.074638:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787388230.074647:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a420b0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787388230.074654:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1874211945768832:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787388230.075105:0:18620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787388230.076129:0:18594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787388230.076162:0:18594:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787388230.076184:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a44757e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44757eb expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388230.076196:0:18594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4e200/0x26817551a44757e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a44757eb expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787388230.076246:0:18594:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787388230.076248:0:18594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787388230.076250:0:18594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388230.076252:0:18594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388230.076253:0:18594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388230.076255:0:18594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388230.076256:0:18594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787388230.076258:0:18594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388230.076260:0:18594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787388230.076264:0:18594:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787388230.076267:0:18594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787388230.076268:0:18594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787388230.076269:0:18594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787388230.076271:0:18594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787388230.076272:0:18594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787388230.076273:0:18594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787388230.076274:0:18594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787388230.076275:0:18594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787388230.076276:0:18594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787388230.076297:0:18594:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787388230.076314:0:18594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945768960:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787388230.076389:0:18594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388230.076431:0:18594:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eea900 going to sleep for 11 seconds 00000100:00100000:1.0:1787388230.076684:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945768960 00000100:00100000:1.0:1787388230.076694:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945768960 00000100:00100000:1.0:1787388230.076741:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787388230.076872:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945768960:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787388230.076899:0:17088:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787388230.076915:0:17088:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787388230.078858:0:17088:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787388230.078871:0:17088:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787388230.079098:0:17110:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787388230.079103:0:17110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1787388230.079119:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:18594:x1874211945768960:12345-0@lo:253:mount.lustre.0 Request processed in 2250us (2727us total) trans 0 rc 0/0 00010000:00010000:0.0:1787388230.079124:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388230.079130:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:0.0:1787388230.079138:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b52f5cc00/0x26817551a4475766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447575f expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388230.079145:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b52f4fa00/0x26817551a4475774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447576d expref: 20 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388230.079153:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388230.079186:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b52f4fa00/0x26817551a4475774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a447576d expref: 20 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388230.079198:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b52f4fa00/0x26817551a4475774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a447576d expref: 20 pid: 17087 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388230.079212:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945769088:0@lo:104: 00000100:00100000:0.0:1787388230.079248:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787388230.079292:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b52f5cc00/0x26817551a4475766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a447575f expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388230.079301:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b52f5cc00/0x26817551a4475766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a447575f expref: 20 pid: 17089 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388230.079321:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945769216:0@lo:104: 00000100:00100000:0.0:1787388230.079376:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388230.079407:0:17110:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787388230.079415:0:18594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:18594:1874211945768960:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787388230.079427:0:18594:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787388230.079430:0:18594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787388230.079432:0:18594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787388230.079433:0:18594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388230.079435:0:18594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388230.079436:0:18594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388230.079437:0:18594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388230.079439:0:18594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787388230.079441:0:18594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388230.079442:0:18594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787388230.079455:0:18594:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787388230.079494:0:17079:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787388230.079515:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945769088 00000100:00100000:2.0:1787388230.079521:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945769088 00000100:00100000:2.0:1787388230.079547:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945769216 00000100:00100000:2.0:1787388230.079551:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945769216 00000100:00100000:2.0:1787388230.079569:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787388230.079577:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+4:17110:x1874211945769088:12345-0@lo:104: 00010000:00010000:2.0:1787388230.079589:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388230.079643:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388230.079650:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+4:17110:x1874211945769088:12345-0@lo:104: Request processed in 74us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388230.079656:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787388230.079671:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787388230.079679:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a42229850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:17110:x1874211945769216:12345-0@lo:104: 00010000:00010000:2.0:1787388230.079686:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388230.079726:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787388230.079731:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a42229850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:17110:x1874211945769216:12345-0@lo:104: Request processed in 54us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388230.079739:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787388230.079786:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787388230.079793:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388230.079801:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787388230.079806:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388230.079814:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388230.079822:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388230.079834:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787388230.079863:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388230.079871:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388230.079890:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388230.079897:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a447576d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475774 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388230.079909:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388230.079913:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388230.079920:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7a00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:3.0:1787388230.079923:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388230.079930:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787388230.079937:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388230.079942:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787388230.079957:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388230.079964:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787388230.079976:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388230.079982:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a432f7a00/0x26817551a447575f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475766 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388230.079996:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388230.079998:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388230.080000:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388230.080010:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388230.080031:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945769344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388230.080065:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388230.080098:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388230.080105:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945769472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388230.080129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388230.080196:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945769088:0@lo:104: 00000100:00100000:0.0:1787388230.080204:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945769216:0@lo:104: 00010000:00010000:0.0:1787388230.080220:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388230.080288:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945769344 00000100:00100000:1.0:1787388230.080293:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945769344 00010000:00010000:1.0:1787388230.080311:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b52f4fa00/0x26817551a4475774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447576d expref: 21 pid: 17087 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388230.080343:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945769472 00000100:00100000:1.0:1787388230.080366:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945769472 00010000:00010000:1.0:1787388230.080379:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b52f5cc00/0x26817551a4475766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447575f expref: 22 pid: 17089 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388230.080394:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388230.080409:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:3649:x1874211945769344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388230.080420:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787388230.080426:0:17081:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787388230.080427:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b52f4fa00/0x26817551a4475774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447576d expref: 22 pid: 17087 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080438:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b52f4fa00/0x26817551a4475774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a447576d expref: 22 pid: 17087 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388230.080446:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787388230.080454:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b52f4fa00/0x26817551a4475774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a447576d expref: 22 pid: 17087 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388230.080455:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787388230.080470:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388230.080511:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:3649:x1874211945769344:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388230.080518:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388230.080533:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787388230.080539:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74e66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:3649:x1874211945769472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787388230.080547:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388230.080552:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b52f5cc00/0x26817551a4475766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a447575f expref: 20 pid: 17089 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080560:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b52f5cc00/0x26817551a4475766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a447575f expref: 20 pid: 17089 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080571:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b52f5cc00/0x26817551a4475766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a447575f expref: 20 pid: 17089 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080584:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080603:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787388230.080616:0:17080:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010244960s 00010000:00010000:1.0:1787388230.080621:0:17080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080628:0:17080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080635:0:17080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080641:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080647:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388230.080651:0:17080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080658:0:17080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080673:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080681:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388230.080707:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74e66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:3649:x1874211945769472:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388230.080714:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787388230.080840:0:17110:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080849:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388230.080855:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40031400/0x26817551a447581c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787388230.082150:0:18594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787388230.083608:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945769472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388230.083624:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945769344:0@lo:103:ldlm_bl.0 00002000:00080000:1.0:1787388230.092181:0:18594:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787388230.092191:0:18594:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787388230.092224:0:18594:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787388230.092279:0:18594:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787388230.092300:0:18594:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787388230.092319:0:18594:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787388230.092964:0:18594:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388230.093180:0:18594:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787388230.636782:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787388230.906156:0:18675:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787388230.906387:0:18675:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787388231.404965:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388231.404988:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945769600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388231.405058:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388231.405159:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945769600 00000100:00100000:1.0:1787388231.405168:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945769600 00000100:00100000:1.0:1787388231.405230:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787388231.405241:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945769600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787388231.405273:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787388231.405324:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945769600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388231.405331:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787388231.405414:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945769600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388231.405517:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945769728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388231.405542:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388231.405606:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945769728 00000100:00100000:2.0:1787388231.405611:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945769728 00000100:00100000:2.0:1787388231.405639:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787388231.405645:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945769728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388231.405662:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388231.405696:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945769728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388231.405713:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787388231.405744:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945769728:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787388231.666800:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787388232.044491:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787388232.044498:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b73a8a800 from 9 10000000:01000000:3.0:1787388232.044503:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787388232.044546:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.044569:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.044581:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388232.044606:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945769856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787388232.044668:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388232.044741:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74ca0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388232.046621:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945769856 00000100:00100000:2.0:1787388232.046638:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945769856 00000100:00100000:3.0:1787388232.047770:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787388232.047781:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+19:17091:x1874211945769856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388232.047797:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388232.047816:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f7a00/0x26817551a447582a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475823 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.047853:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f7a00/0x26817551a447582a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475823 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.047864:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f7a00/0x26817551a447582a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475823 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.047874:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7a00, rc 0) 00000100:00100000:3.0:1787388232.047993:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:17091:x1874211945769856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388232.048000:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787388232.048399:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945769856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388232.048459:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.048469:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388232.048540:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945769984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787388232.048578:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388232.048615:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1787388232.048822:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945769984 00000100:00100000:2.0:1787388232.048829:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945769984 00000100:00100000:2.0:1787388232.048876:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787388232.048883:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:17091:x1874211945769984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787388232.048912:0:17088:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787388232.049009:0:17088:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787388232.049013:0:17088:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787388232.049097:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:17091:x1874211945769984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 213us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388232.049104:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787388232.049213:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945769984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787388232.049282:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787388232.049289:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.049297:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388232.049307:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787388232.049309:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996a44056800 from 9 10000000:01000000:1.0:1787388232.049312:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787388232.049332:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.049340:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.049494:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388232.049508:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945770112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787388232.049537:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388232.049566:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1787388232.049609:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945770112 00000100:00100000:2.0:1787388232.049614:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945770112 00000100:00100000:2.0:1787388232.049642:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787388232.049649:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:17091:x1874211945770112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388232.051681:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388232.051864:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f6a00/0x26817551a4475838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475831 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.051906:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f6a00/0x26817551a4475838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475831 expref: 21 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.051917:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f6a00/0x26817551a4475838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475831 expref: 21 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388232.051927:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6a00, rc 0) 00000100:00100000:3.0:1787388232.051999:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:17091:x1874211945770112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2349us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388232.052008:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787388232.052112:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945770112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388232.052136:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.052146:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388232.052232:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945770240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787388232.052266:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388232.052298:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ea000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388232.052386:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945770240 00000100:00100000:3.0:1787388232.052392:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945770240 00000100:00100000:3.0:1787388232.052431:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787388232.052439:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:17091:x1874211945770240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787388232.052455:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787388232.052470:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787388232.052473:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787388232.052561:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:17091:x1874211945770240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388232.052569:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787388232.052643:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945770240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787388232.052708:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787388232.052715:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388232.052723:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388232.686649:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787388233.330328:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787388233.711105:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388234.734643:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787388235.509584:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388235.509591:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388235.509593:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388235.509596:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388235.509621:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388235.509633:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787388235.509635:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787388235.509638:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787388235.509684:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945770496:0@lo:400:kworker.0 00000100:00100000:0.0:1787388235.509716:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945770368:0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.509750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388235.509750:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388235.510606:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945771008:0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.510649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388235.510691:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945770624:0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.510715:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388235.510734:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945771136:0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.510757:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388235.510775:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388235.510781:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945770752:0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.510802:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388235.510833:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945770368 00000100:00100000:3.0:1787388235.510840:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945770368 00000100:00100000:3.0:1787388235.510883:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787388235.510891:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:3649:x1874211945770368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.511080:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:3649:x1874211945770368:12345-0@lo:400:kworker.0 Request processed in 189us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388235.511088:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787388235.511571:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945770496 00000100:00100000:3.0:1787388235.511577:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945770496 00000100:00100000:3.0:1787388235.511597:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945770752 00000100:00100000:3.0:1787388235.511600:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945770752 00000100:00100000:3.0:1787388235.511620:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787388235.511626:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945770496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.511674:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945770496:12345-0@lo:400:kworker.0 Request processed in 47us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388235.511680:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787388235.511691:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787388235.511697:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945770752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.511727:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945770752:12345-0@lo:400:kworker.0 Request processed in 30us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388235.511732:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787388235.511751:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945771008 00000100:00100000:3.0:1787388235.511754:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945771008 00000100:00100000:3.0:1787388235.511840:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945770624 00000100:00100000:3.0:1787388235.511844:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945770624 00000100:00100000:3.0:1787388235.511855:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945771136 00000100:00100000:3.0:1787388235.511857:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945771136 00000100:00080000:2.0:1787388235.511907:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388235.511911:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388235.512136:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787388235.512143:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945771008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.512179:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945771008:12345-0@lo:400:kworker.0 Request processed in 37us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388235.512186:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787388235.512197:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787388235.512202:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945770624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.512239:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945770624:12345-0@lo:400:kworker.0 Request processed in 25us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388235.512245:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787388235.512255:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787388235.512268:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945771136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.512295:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945771136:12345-0@lo:400:kworker.0 Request processed in 28us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388235.512302:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787388235.512367:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945770752:0@lo:400:kworker.0 00010000:00080000:3.0:1787388235.512383:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b412ae300 x1874211945770624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388235.512394:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945770624:0@lo:400:kworker.0 00010000:00080000:3.0:1787388235.512403:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b412ad180 x1874211945771136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388235.512412:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945771136:0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.512457:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945770496:0@lo:400:kworker.0 00010000:00080000:3.0:1787388235.512466:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b412aed80 x1874211945771008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388235.512474:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945771008:0@lo:400:kworker.0 00000100:00100000:0.0:1787388235.513055:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945770368:0@lo:400:kworker.0 00000100:00100000:0.0:1787388235.513065:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945770880:0@lo:400:kworker.0 00000100:00100000:0.0:1787388235.513097:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388235.513557:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945770880 00000100:00100000:3.0:1787388235.513563:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945770880 00000100:00100000:3.0:1787388235.513605:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787388235.513612:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945770880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388235.513654:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945770880:12345-0@lo:400:kworker.0 Request processed in 42us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388235.513661:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787388235.513692:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b412af100 x1874211945770880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388235.513709:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945770880:0@lo:400:kworker.0 00010000:00010000:0.0:1787388235.757371:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787388235.836400:0:18965:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787388236.524497:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945771264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388236.524566:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388236.524623:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945771264 00000100:00100000:2.0:1787388236.524630:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945771264 00000100:00100000:2.0:1787388236.524682:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787388236.524691:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945771264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388236.524724:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388236.524777:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945771264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388236.524785:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787388236.524841:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945771264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787388236.525035:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945771392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388236.525065:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388236.525128:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945771392 00000100:00100000:2.0:1787388236.525132:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945771392 00000100:00100000:2.0:1787388236.525163:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787388236.525169:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945771392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388236.525186:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388236.525233:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945771392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388236.525240:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787388236.525267:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945771392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787388236.780575:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787388236.812139:0:19017:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388236.812864:0:19017:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1787388237.803997:0:19067:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787388237.804272:0:19067:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787388237.804469:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787388238.508982:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787388238.834331:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388239.854438:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388240.305753:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388225/real 1787388225] req@ffff996b412ad880 x1874211945763712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388240 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.305790:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b412ad880 x1874211945763712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388240 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.305802:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388225/real 1787388225] req@ffff996b412ac000 x1874211945763840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388240 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.305837:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b412ac000 x1874211945763840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388240 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787388240.305859:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a423b5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787388240.305882:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787388240.305887:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945763712:0@lo:8:kworker.0 00000100:00080000:2.0:1787388240.305892:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a43023800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787388240.305897:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787388240.305901:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945763840:0@lo:8:kworker.0 00000100:00080000:2.0:1787388240.306017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388240.306022:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388240.306026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388240.306029:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787388240.306046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388240.306049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787388240.306052:0:36:0:(import.c:65:import_set_state_nolock()) ffff996a423b5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787388240.306058:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 546 00000100:00080000:2.0:1787388240.306064:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787388240.306073:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff996a423b5800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787388240.306097:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f5e0380 x1874211945772032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787388240.306110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388240.306113:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787388240.306121:0:36:0:(import.c:65:import_set_state_nolock()) ffff996a43023800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787388240.306124:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 546 00000100:00080000:2.0:1787388240.306128:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787388240.306132:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff996a43023800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787388240.306145:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f5e0000 x1874211945772160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787388240.306190:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945771904:0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.306277:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.306338:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787388240.306344:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945771520:0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.306387:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.306408:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945772288:0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.306432:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.306457:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945771648:0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.306478:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.306493:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945772416:0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.306517:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.306535:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787388240.306539:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945771776:0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.306564:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.306578:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945772544:0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.306605:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.306632:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945771904 00000100:00100000:2.0:1787388240.306641:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945771904 00000100:00100000:2.0:1787388240.306683:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945771648 00000100:00100000:2.0:1787388240.306691:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945771648 00000100:00100000:2.0:1787388240.306709:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787388240.306718:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945771904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.306782:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945771904:12345-0@lo:400:kworker.0 Request processed in 63us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.306790:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787388240.306811:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787388240.306817:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945771648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.306848:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945771648:12345-0@lo:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.306855:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787388240.306873:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945771520 00000100:00100000:2.0:1787388240.306877:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945771520 00000100:00100000:2.0:1787388240.306903:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787388240.306909:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:3649:x1874211945771520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.306938:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:3649:x1874211945771520:12345-0@lo:400:kworker.0 Request processed in 29us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.306944:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787388240.306976:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945772288 00000100:00100000:2.0:1787388240.306980:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945772288 00000100:00100000:2.0:1787388240.306996:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945772416 00000100:00100000:2.0:1787388240.307013:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945772416 00000100:00100000:2.0:1787388240.307036:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945771776 00000100:00100000:2.0:1787388240.307039:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945771776 00000100:00100000:2.0:1787388240.307049:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945772544 00000100:00100000:2.0:1787388240.307051:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945772544 00000100:00100000:2.0:1787388240.307065:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787388240.307070:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945772288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.307109:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874211945772288:12345-0@lo:400:kworker.0 Request processed in 38us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.307115:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787388240.307128:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787388240.307134:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945772416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.307157:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874211945772416:12345-0@lo:400:kworker.0 Request processed in 24us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.307163:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787388240.307174:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787388240.307179:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945771776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.307204:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874211945771776:12345-0@lo:400:kworker.0 Request processed in 24us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.307209:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787388240.307219:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787388240.307224:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945772544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.307248:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945772544:12345-0@lo:400:kworker.0 Request processed in 24us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.307254:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787388240.307287:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388240.307292:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787388240.307723:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f5e2a00 x1874211945771776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.307739:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874211945771776:0@lo:400:kworker.0 00010000:00080000:2.0:1787388240.307754:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f5e2300 x1874211945772544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.307774:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945772544:0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.307790:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945771648:0@lo:400:kworker.0 00010000:00080000:2.0:1787388240.307799:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f5e0700 x1874211945772416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.307806:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1874211945772416:0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.316981:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945772032:0@lo:8:kworker.0 00000100:00100000:2.0:1787388240.317093:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.317148:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945772160:0@lo:8:kworker.0 00000100:00100000:0.0:1787388240.317251:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945772032 00000100:00100000:0.0:1787388240.317261:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945772032 00000100:00100000:0.0:1787388240.317307:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388240.317317:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1874211945772032:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787388240.317378:0:18599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:0.0:1787388240.317413:0:18599:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a447583f 00002000:00100000:0.0:1787388240.317431:0:18599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff996a420b7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787388240.317436:0:18599:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787388240.317439:0:18599:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787388240.317652:0:18599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787388240.317684:0:18599:0:(import.c:65:import_set_state_nolock()) ffff996a420b4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388240.317746:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1874211945772032:12345-0@lo:8:kworker.0 Request processed in 429us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388240.317755:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787388240.317853:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787388240.317909:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f5e0380 x1874211945772032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787388260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.317922:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787388240.317932:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787388240.317941:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787388240.317948:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787388240.317950:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a423b5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787388240.318019:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945772160 00000100:00100000:0.0:1787388240.318024:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945772160 00000100:00100000:0.0:1787388240.318043:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787388240.318049:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1874211945772160:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787388240.318063:0:18601:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:3.0:1787388240.320312:0:17835:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787388240.320317:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787388240.320335:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945772032:0@lo:8:kworker.0 00000004:00080000:3.0:1787388240.320455:0:17835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 561843107753ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787388240.320462:0:17835:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787388240.320683:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945771520:0@lo:400:kworker.0 00010000:00080000:2.0:1787388240.320704:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f5e1500 x1874211945772288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.320717:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874211945772288:0@lo:400:kworker.0 00000100:00100000:2.0:1787388240.320739:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945771904:0@lo:400:kworker.0 00000004:00080000:1.0:1787388240.322312:0:17836:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787388240.322363:0:17836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17836:1874211945772800:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787388240.322448:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388240.322484:0:17836:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388240.323623:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945772672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388240.323690:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.324490:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945772672 00000100:00100000:2.0:1787388240.324503:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945772672 00000100:00100000:2.0:1787388240.324576:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787388240.324585:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874211945772672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388240.324623:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787388240.324693:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874211945772672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.324701:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787388240.324726:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787388240.327332:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f58f480 x1874211945772672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.327383:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945772672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388240.334861:0:18599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787388240.334878:0:18599:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787388240.335847:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787388240.336027:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945772800 00000100:00100000:1.0:1787388240.336038:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945772800 00000100:00100000:1.0:1787388240.336894:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1874211945772160:12345-0@lo:8:kworker.0 Request processed in 18833us (19029us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787388240.336921:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787388240.336989:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a43023800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787388240.336997:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787388240.337011:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945772160:0@lo:8:kworker.0 00000100:00100000:1.0:1787388240.337046:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787388240.337057:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17836:x1874211945772800:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787388240.339403:0:17827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1787388240.358145:0:18601:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787388240.358160:0:18601:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787388240.359141:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17836:x1874211945772800:12345-0@lo:7:osp-pre-0-1.0 Request processed in 22073us (36678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388240.359168:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787388240.362668:0:17836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f58ce00 x1874211945772800/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787388256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388240.362693:0:17836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17836:1874211945772800:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787388240.362712:0:17836:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787388240.363311:0:17836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17836:1874211945772928:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787388240.363483:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388240.363529:0:17836:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b7292dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787388240.364038:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945772928 00000100:00100000:1.0:1787388240.364049:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945772928 00000100:00100000:1.0:1787388240.364116:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787388240.364127:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17836:x1874211945772928:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787388240.364167:0:18600:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1787388240.364255:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17836:x1874211945772928:12345-0@lo:5:osp-pre-0-1.0 Request processed in 130us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388240.364263:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787388240.364339:0:17836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b738ea300 x1874211945772928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787388256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.364376:0:17836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17836:1874211945772928:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787388240.364390:0:17836:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787388240.364454:0:17836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17836:1874211945773056:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787388240.364492:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.364526:0:17836:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b481ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388240.364574:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945773056 00000100:00100000:1.0:1787388240.364580:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945773056 00000100:00100000:1.0:1787388240.364611:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787388240.364618:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17836:x1874211945773056:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787388240.364649:0:19184:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1787388240.399729:0:18595:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787388240.399753:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787388240.400183:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17836:x1874211945773056:12345-0@lo:5:osp-pre-0-1.0 Request processed in 35549us (35673us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787388240.400198:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787388240.401986:0:17836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c108a80 x1874211945773056/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787388256 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388240.402015:0:17836:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787388240.402025:0:17836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17836:1874211945773056:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787388240.402046:0:17836:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1787388240.402128:0:17836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17836:1874211945773184:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787388240.402212:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388240.402399:0:17836:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b481ccb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388240.402712:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945773184 00000100:00100000:0.0:1787388240.402723:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945773184 00000100:00100000:0.0:1787388240.402891:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787388240.402903:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17836:x1874211945773184:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787388240.403009:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17836:x1874211945773184:12345-0@lo:900:osp-pre-0-1.0 Request processed in 99us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388240.403019:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787388240.403088:0:17836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c108a80 x1874211945773184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787388256 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388240.403102:0:17836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c108a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17836:1874211945773184:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1787388240.876548:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388241.648846:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945773312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388241.648916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388241.648968:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945773440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388241.649019:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388241.649051:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945773312 00000100:00100000:2.0:1787388241.649059:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945773312 00000100:00100000:2.0:1787388241.649095:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945773440 00000100:00100000:2.0:1787388241.649098:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945773440 00000100:00100000:2.0:1787388241.649114:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787388241.649122:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945773312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388241.649154:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388241.649196:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945773312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388241.649203:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787388241.649845:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787388241.649853:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945773440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388241.649874:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388241.649915:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945773440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388241.649921:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787388241.650030:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945773440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388241.650067:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945773312:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388241.900948:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388242.930223:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388243.579121:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787388243.949835:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388244.972987:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787388245.139169:0:19413:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787388245.139173:0:19413:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787388245.139175:0:19413:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787388245.139288:0:19413:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff996a42cab000 00000020:01000004:1.0:1787388245.139303:0:19413:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787388245.139318:0:19413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787388245.139331:0:19413:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff996b483419c0) 00000020:00000080:1.0:1787388245.139389:0:19413:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787388245.202908:0:19413:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787388245.204389:0:19413:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787388245.204690:0:19413:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787388245.204840:0:19413:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787388245.205013:0:19413:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787388245.205211:0:19413:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787388245.205521:0:19413:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1787388245.207279:0:19413:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787388245.207516:0:19413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787388245.207529:0:19413:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787388245.207539:0:19413:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26817551a447584d 00000020:01000004:2.0:1787388245.207544:0:19413:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787388245.207565:0:19413:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787388245.207568:0:19413:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787388245.207573:0:19413:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787388245.207600:0:19413:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787388245.207604:0:19413:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787388245.222132:0:19413:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787388245.222181:0:19413:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.115@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787388245.222185:0:19413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787388245.222196:0:19413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787388245.222197:0:19413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388245.222198:0:19413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388245.222199:0:19413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388245.222201:0:19413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388245.222202:0:19413:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787388245.222204:0:19413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388245.222205:0:19413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787388245.222209:0:19413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787388245.222211:0:19413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787388245.222212:0:19413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787388245.222213:0:19413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388245.222214:0:19413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388245.222215:0:19413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388245.222216:0:19413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388245.222217:0:19413:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787388245.222218:0:19413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388245.222219:0:19413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787388245.222245:0:19413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787388245.222274:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945773568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787388245.222392:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388245.222443:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b481cc000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388245.222695:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945773568 00000100:00100000:3.0:1787388245.222703:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945773568 00000100:00100000:3.0:1787388245.222756:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787388245.222765:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:19413:x1874211945773568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787388245.222795:0:17089:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787388245.222798:0:17089:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787388245.222802:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787388245.223327:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:19413:x1874211945773568:12345-0@lo:253:mount.lustre.0 Request processed in 562us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388245.223336:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787388245.223524:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945773568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787388245.223535:0:19413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787388245.223537:0:19413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787388245.223539:0:19413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787388245.223541:0:19413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787388245.223542:0:19413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787388245.223543:0:19413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787388245.223544:0:19413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787388245.223546:0:19413:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787388245.223547:0:19413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787388245.223548:0:19413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787388245.223569:0:19413:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996a42cab000 from lustre-OST0001 10000000:01000000:0.0:1787388245.223593:0:19413:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787388245.223595:0:19413:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787388245.223604:0:19413:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff996b72b80000 local copy 00010000:00010000:0.0:1787388245.223614:0:19413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388245.223713:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945773696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388245.223746:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388245.223779:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b481cc540 going to sleep for 11 seconds 00000100:00100000:2.0:1787388245.223826:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945773696 00000100:00100000:2.0:1787388245.223831:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945773696 00000100:00100000:2.0:1787388245.224032:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787388245.224041:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:19413:x1874211945773696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388245.224113:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:19413:x1874211945773696:12345-0@lo:501:mount.lustre.0 Request processed in 74us (366us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787388245.224120:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787388245.224238:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945773696:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787388245.224251:0:19413:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787388245.224272:0:19413:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787388245.224278:0:19413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388245.224287:0:19413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5da00/0x26817551a4475567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447556e expref: -99 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388245.224322:0:19413:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996a42cab000 10000000:01000000:1.0:1787388245.224327:0:19413:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787388245.224332:0:19413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787388245.224335:0:19413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787388245.224339:0:19413:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787388245.224342:0:19413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787388245.224396:0:19413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388245.224405:0:19413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388245.224413:0:19413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388245.224435:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945773824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388245.224464:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.224486:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431ea780 going to sleep for 11 seconds 00000100:00100000:0.0:1787388245.224557:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945773824 00000100:00100000:0.0:1787388245.224562:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945773824 00000100:00100000:0.0:1787388245.224588:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787388245.224594:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:19413:x1874211945773824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787388245.224602:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388245.224614:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b40031400/0x26817551a447585b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475854 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388245.224647:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b40031400/0x26817551a447585b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475854 expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388245.224657:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b40031400/0x26817551a447585b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475854 expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388245.224666:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b40031400, rc 0) 00000100:00100000:0.0:1787388245.224703:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:19413:x1874211945773824:12345-0@lo:101:mount.lustre.0 Request processed in 109us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388245.224709:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787388245.225297:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945773824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787388245.225312:0:19413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447585b expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388245.225322:0:19413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a447585b expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787388245.227280:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787388245.228100:0:19413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787388245.230841:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787388245.230893:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787388245.230909:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787388245.230922:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787388245.230934:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787388245.230948:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787388245.231003:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787388245.231010:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787388245.231118:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945773952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388245.231189:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.231233:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388245.231786:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945773952 00000100:00100000:0.0:1787388245.231794:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945773952 00000100:00100000:0.0:1787388245.231850:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787388245.231859:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:19413:x1874211945773952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388245.232660:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:19413:x1874211945773952:12345-0@lo:501:mount.lustre.0 Request processed in 800us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388245.232668:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787388245.232723:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945773952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388245.232764:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388245.232815:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388245.232896:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b481ccc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388245.233060:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945774080 00000100:00100000:3.0:1787388245.233067:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945774080 00000100:00100000:3.0:1787388245.233109:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787388245.233118:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:19413:x1874211945774080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388245.236249:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:19413:x1874211945774080:12345-0@lo:503:mount.lustre.0 Request processed in 3126us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388245.236261:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787388245.236400:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774080:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787388245.236761:0:19413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787388245.236844:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388245.236900:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.236926:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b59c39000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388245.237093:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945774208 00000100:00100000:3.0:1787388245.237100:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945774208 00000100:00100000:3.0:1787388245.237138:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787388245.237146:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:19413:x1874211945774208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388245.237624:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:19413:x1874211945774208:12345-0@lo:502:mount.lustre.0 Request processed in 478us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388245.237630:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787388245.237697:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388245.237852:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787388245.238052:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787388245.238067:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787388245.238077:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787388245.238086:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787388245.238096:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787388245.238106:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787388245.238115:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787388245.238125:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787388245.238147:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388245.238180:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.238267:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b59c39000 going to sleep for 11 seconds 00000100:00100000:3.0:1787388245.238311:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945774336 00000100:00100000:3.0:1787388245.238315:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945774336 00000100:00100000:3.0:1787388245.238368:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787388245.238375:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:19413:x1874211945774336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787388245.238442:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:19413:x1874211945774336:12345-0@lo:502:mount.lustre.0 Request processed in 68us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388245.238449:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787388245.238601:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388245.238638:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787388245.238646:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787388245.239375:0:19417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787388245.239383:0:19417:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787388245.239388:0:19417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388245.239391:0:19417:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787388245.239396:0:19417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787388245.239408:0:19417:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff996b48343380) 00000020:00000080:1.0:1787388245.239430:0:19417:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787388245.239435:0:19417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787388245.239502:0:19417:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996a42cab000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787388245.239509:0:19417:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787388245.239515:0:19417:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26817551a4475869 00010000:00010000:1.0:1787388245.244760:0:19417:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787388245.245476:0:19417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1787388245.247487:0:19417:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787388245.248863:0:19417:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787388245.248889:0:19417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388245.248897:0:19417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388245.248899:0:19417:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787388245.248903:0:19417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388245.248907:0:19417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388245.248909:0:19417:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787388245.248912:0:19417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787388245.248914:0:19417:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787388245.248916:0:19417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388245.248919:0:19417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388245.248920:0:19417:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787388245.248923:0:19417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388245.248925:0:19417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388245.248927:0:19417:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787388245.248930:0:19417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787388245.248976:0:19417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388245.248981:0:19417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388245.248982:0:19417:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787388245.248985:0:19417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787388245.256468:0:19413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787388245.256516:0:19413:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787388245.258471:0:19413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447585b expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388245.258489:0:19413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4f800/0x26817551a4475854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a447585b expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388245.258497:0:19413:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996a42cab000 from 1 10000000:01000000:1.0:1787388245.258500:0:19413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787388245.258537:0:19413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388245.258545:0:19413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388245.258555:0:19413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388245.258580:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787388245.258643:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.258676:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388245.258975:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945774464 00000100:00100000:3.0:1787388245.258983:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945774464 00000100:00100000:3.0:1787388245.259038:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787388245.259049:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:19413:x1874211945774464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388245.259062:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388245.259075:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f7800/0x26817551a4475877 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475870 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388245.259097:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f7800/0x26817551a4475877 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475870 expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388245.259123:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f7800/0x26817551a4475877 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475870 expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388245.259131:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7800, rc 0) 00000100:00100000:3.0:1787388245.259200:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:19413:x1874211945774464:12345-0@lo:101:mount.lustre.0 Request processed in 142us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388245.259207:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787388245.259270:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787388245.259284:0:19413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388245.259294:0:19413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787388245.262329:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787388245.262659:0:19413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787388245.262849:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787388245.263033:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787388245.263059:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787388245.263065:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787388245.263274:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787388245.263338:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388245.263552:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422a40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388245.263594:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945774592 00000100:00100000:2.0:1787388245.263601:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945774592 00000100:00100000:2.0:1787388245.263648:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787388245.263658:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:19413:x1874211945774592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787388245.263829:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:19413:x1874211945774592:12345-0@lo:501:mount.lustre.0 Request processed in 172us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.263838:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787388245.264069:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388245.264106:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388245.264292:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.264373:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787388245.264499:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945774720 00000100:00100000:3.0:1787388245.264509:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945774720 00000100:00100000:3.0:1787388245.264573:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787388245.264581:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:19413:x1874211945774720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787388245.264674:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:19413:x1874211945774720:12345-0@lo:503:mount.lustre.0 Request processed in 93us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388245.264681:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787388245.264758:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787388245.265158:0:19413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787388245.265238:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388245.265282:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.265730:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388245.266293:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945774848 00000100:00100000:2.0:1787388245.266301:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945774848 00000100:00100000:2.0:1787388245.266336:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787388245.266373:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:19413:x1874211945774848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388245.266502:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:19413:x1874211945774848:12345-0@lo:502:mount.lustre.0 Request processed in 157us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.266510:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787388245.266610:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388245.266811:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787388245.266839:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787388245.266853:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787388245.266876:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787388245.266895:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787388245.266908:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787388245.266921:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787388245.266933:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787388245.266947:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787388245.266994:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787388245.267012:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787388245.267041:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388245.267088:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.267114:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b74eeaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388245.267444:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945774976 00000100:00100000:2.0:1787388245.267450:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945774976 00000100:00100000:2.0:1787388245.267478:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787388245.267486:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:19413:x1874211945774976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787388245.267575:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:19413:x1874211945774976:12345-0@lo:502:mount.lustre.0 Request processed in 89us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.267582:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787388245.267673:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945774976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787388245.267717:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787388245.267726:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787388245.269604:0:19421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388245.269616:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388245.269626:0:19421:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787388245.269635:0:19421:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996a42cab000 00000020:00000080:1.0:1787388245.269638:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787388245.269645:0:19421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388245.269648:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388245.269650:0:19421:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787388245.269653:0:19421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388245.269655:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388245.269657:0:19421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787388245.269660:0:19421:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996a42cab000 00000020:00000080:1.0:1787388245.269662:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787388245.269832:0:19421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787388245.269837:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388245.269839:0:19421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787388245.269841:0:19421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787388245.269844:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787388245.269845:0:19421:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787388245.269849:0:19421:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996a42cab000 00000020:00000080:1.0:1787388245.269851:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787388245.270750:0:19421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388245.273452:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388245.273460:0:19421:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787388245.273472:0:19421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787388245.273479:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388245.273481:0:19421:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787388245.273487:0:19421:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996a42cab000 00000020:00000080:2.0:1787388245.273491:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787388245.273566:0:19421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787388245.273570:0:19421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787388245.273571:0:19421:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787388245.273575:0:19421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787388245.273707:0:19413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787388245.273762:0:19413:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787388245.273781:0:19413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.273793:0:19413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388245.273856:0:19413:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787388245.273860:0:19413:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996a42cab000 10000000:01000000:2.0:1787388245.273863:0:19413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996a42cab000 10000000:01000000:2.0:1787388245.273876:0:19413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787388245.273883:0:19413:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996a42cab000 from 1 10000000:01000000:2.0:1787388245.273886:0:19413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787388245.273921:0:19413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5cc00/0x26817551a447587e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.273929:0:19413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f5cc00/0x26817551a447587e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.273939:0:19413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f5cc00/0x26817551a447587e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388245.273980:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787388245.274046:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.274084:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945775104 00000100:00100000:2.0:1787388245.274091:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945775104 00000100:00100000:2.0:1787388245.274148:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787388245.274157:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:19413:x1874211945775104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388245.274170:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388245.274971:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f5c200/0x26817551a4475885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a447587e expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.275004:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f5c200/0x26817551a4475885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a447587e expref: 24 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.275016:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f5c200/0x26817551a4475885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a447587e expref: 24 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.275024:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c200, rc 0) 00000100:00100000:2.0:1787388245.275073:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775104:12345-0@lo:101:mount.lustre.0 Request processed in 917us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.275081:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787388245.275131:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a431eee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787388245.275296:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c109880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787388245.275312:0:19413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f5cc00/0x26817551a447587e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475885 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.275321:0:19413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f5cc00/0x26817551a447587e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475885 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787388245.281314:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787388245.281629:0:19413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787388245.281856:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787388245.283103:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787388245.283126:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787388245.283149:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787388245.283174:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787388245.284309:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787388245.284371:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787388245.284403:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787388245.284420:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787388245.284436:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787388245.284452:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787388245.284467:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787388245.284482:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787388245.284498:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787388245.284513:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787388245.284529:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787388245.284545:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787388245.284561:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787388245.284575:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787388245.284590:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787388245.284604:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787388245.284619:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787388245.284635:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787388245.284652:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787388245.284668:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787388245.284684:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787388245.284698:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787388245.284712:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787388245.284727:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787388245.284743:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787388245.284774:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787388245.284789:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787388245.284802:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787388245.284814:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787388245.284828:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787388245.284843:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787388245.284855:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787388245.287464:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787388245.287545:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787388245.287564:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787388245.287591:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787388245.287608:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787388245.287623:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787388245.287637:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787388245.287653:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787388245.287669:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787388245.287715:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787388245.287723:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787388245.287826:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388245.287908:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388245.290503:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b481cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1787388245.290640:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945775232 00000100:00100000:1.0:1787388245.290650:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945775232 00000100:00100000:1.0:1787388245.290707:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787388245.290718:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787388245.290893:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775232:12345-0@lo:501:mount.lustre.0 Request processed in 177us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388245.290901:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787388245.291122:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787388245.292099:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787388245.292171:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388245.292287:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b481cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1787388245.293159:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945775360 00000100:00100000:1.0:1787388245.293169:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945775360 00000100:00100000:1.0:1787388245.293295:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787388245.293305:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787388245.293460:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775360:12345-0@lo:503:mount.lustre.0 Request processed in 156us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388245.293468:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787388245.293595:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775360:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787388245.294183:0:19413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787388245.297199:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388245.297277:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388245.297325:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945775488 00000100:00100000:0.0:1787388245.297331:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945775488 00000100:00100000:0.0:1787388245.297389:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787388245.297398:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388245.297506:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775488:12345-0@lo:502:mount.lustre.0 Request processed in 109us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388245.297514:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787388245.297571:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b481cc480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388245.297592:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787388245.297791:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787388245.297821:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787388245.297833:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787388245.297845:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787388245.297857:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787388245.297868:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787388245.297880:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787388245.297891:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787388245.297902:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787388245.297913:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787388245.297924:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787388245.297936:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787388245.297948:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787388245.297985:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787388245.298000:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787388245.298011:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787388245.298022:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787388245.298033:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787388245.298044:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787388245.298055:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787388245.298067:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787388245.298080:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787388245.298092:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787388245.298104:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787388245.298116:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787388245.298127:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787388245.298139:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787388245.298151:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787388245.298162:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787388245.298184:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787388245.298206:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787388245.298217:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787388245.298230:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787388245.298242:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787388245.298254:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787388245.298265:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787388245.298275:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787388245.298285:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787388245.298295:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787388245.298304:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787388245.298314:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787388245.298323:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787388245.298332:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787388245.298341:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787388245.298375:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787388245.298399:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787388245.298411:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787388245.298421:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787388245.298453:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388245.298497:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388245.298525:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b481cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1787388245.298864:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945775616 00000100:00100000:1.0:1787388245.298871:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945775616 00000100:00100000:1.0:1787388245.298912:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787388245.298920:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787388245.299037:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775616:12345-0@lo:502:mount.lustre.0 Request processed in 117us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388245.299045:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787388245.301764:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787388245.302520:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787388245.302554:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787388245.302592:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388245.302659:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388245.302699:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945775744 00000100:00100000:0.0:1787388245.302705:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945775744 00000100:00100000:0.0:1787388245.302747:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787388245.302756:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787388245.302860:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945775744:12345-0@lo:502:mount.lustre.0 Request processed in 104us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388245.302874:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787388245.302921:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b481cc480 going to sleep for 11 seconds 00000100:00100000:0.0:1787388245.302938:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945775744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787388245.305837:0:19413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787388245.305855:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787388245.307524:0:19426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787388245.307540:0:19426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff996b739cb380) 00000020:00000080:3.0:1787388245.307563:0:19426:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1787388245.307716:0:19426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996a42cab000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787388245.307720:0:19426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996a42cab000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787388245.307722:0:19426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996a42cab000 3 00010000:00080000:3.0:1787388245.307748:0:19426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996b482a1000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1787388245.312895:0:19426:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1787388245.314100:0:19426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787388245.315517:0:19426:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787388245.315538:0:19426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x26817551a4475893 00000100:00080000:3.0:1787388245.315549:0:19426:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787388245.315556:0:19426:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff996b482a1000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388245.315605:0:19426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7c0c9c00 x1874211945775872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787388245.315667:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1874211945775872:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787388245.315734:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787388245.315793:0:19426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787388245.317493:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945775872 00000100:00100000:1.0:1787388245.317508:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945775872 00000100:00100000:1.0:1787388245.318857:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388245.318868:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874211945775872:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787388245.318910:0:17096:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:1.0:1787388245.318944:0:17096:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x26817551a447589a 00000004:00100000:1.0:1787388245.318959:0:17096:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787388245.319000:0:17096:0:(import.c:65:import_set_state_nolock()) ffff996a441d3000 : changing import state from RECOVER to FULL 00000020:01000004:3.0:1787388245.321621:0:19426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787388245.321638:0:19426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff996b739c8000) 00000020:00000080:3.0:1787388245.321664:0:19426:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1787388245.321817:0:19426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996a42cab000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787388245.321822:0:19426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996a42cab000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787388245.321824:0:19426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996a42cab000 3 00010000:00080000:3.0:1787388245.321853:0:19426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996a420b0000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.115@tcp at head 00000100:00100000:1.0:1787388245.322630:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874211945775872:12345-0@lo:38:llog_process_th.0 Request processed in 3755us (6888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388245.322642:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787388245.323853:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388245.323858:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388245.323861:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388245.323864:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388245.323911:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388245.323915:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787388245.323918:0:38:0:(import.c:65:import_set_state_nolock()) ffff996a43023800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787388245.323924:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:1.0:1787388245.323930:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787388245.323935:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff996a43023800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1787388245.323953:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f58ce00 x1874211945776512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:0.0:1787388245.325832:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c9c00 x1874211945775872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388245.326030:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787388245.326041:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787388245.326051:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787388245.326057:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787388245.326061:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b482a1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787388245.326069:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1874211945775872:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787388245.326106:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945776512:0@lo:8:kworker.0 00000100:00100000:0.0:1787388245.326166:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.326396:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945776512 00000100:00100000:1.0:1787388245.326404:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945776512 00000100:00100000:2.0:1787388245.326439:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945776000:0@lo:400:kworker.0 00000100:00100000:1.0:1787388245.326439:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787388245.326446:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1874211945776512:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787388245.326473:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.326494:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945776640:0@lo:400:kworker.0 00000100:00100000:1.0:1787388245.326501:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1874211945776512:12345-0@lo:8:kworker.0 Request processed in 55us (335us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787388245.326508:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787388245.326515:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.326533:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787388245.326539:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945776384:0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.326561:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.326615:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945776128:0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.326640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.326657:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945776768:0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.326678:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.326696:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787388245.326702:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945776256:0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.326724:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.326741:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945776896:0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.326763:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.326785:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945776000 00000100:00100000:2.0:1787388245.326789:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945776000 00000100:00100000:2.0:1787388245.326811:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945776256 00000100:00100000:2.0:1787388245.326814:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945776256 00000100:00100000:2.0:1787388245.326828:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787388245.326834:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945776000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.326877:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945776000:12345-0@lo:400:kworker.0 Request processed in 43us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.326883:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787388245.326897:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787388245.326902:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945776256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.326932:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945776256:12345-0@lo:400:kworker.0 Request processed in 29us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.326938:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787388245.326975:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945776640 00000100:00100000:2.0:1787388245.326979:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945776640 00000100:00100000:2.0:1787388245.326995:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945776128 00000100:00100000:2.0:1787388245.326998:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945776128 00000100:00100000:2.0:1787388245.327018:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945776768 00000100:00100000:2.0:1787388245.327021:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945776768 00000100:00100000:2.0:1787388245.327045:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945776896 00000100:00100000:2.0:1787388245.327047:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945776896 00000100:00100000:2.0:1787388245.327066:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787388245.327072:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945776640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.327106:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945776640:12345-0@lo:400:kworker.0 Request processed in 34us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.327114:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787388245.327120:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945776384 00000100:00100000:0.0:1787388245.327127:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945776384 00000100:00100000:2.0:1787388245.327131:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787388245.327151:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945776128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388245.327161:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787388245.327171:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945776384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388245.327215:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945776384:12345-0@lo:400:kworker.0 Request processed in 46us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.327262:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874211945776128:12345-0@lo:400:kworker.0 Request processed in 50us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.327269:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787388245.327280:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787388245.327284:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787388245.327293:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945776768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388245.327334:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787388245.327341:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a43023800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787388245.327372:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787388245.327376:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945776512:0@lo:8:kworker.0 00010000:00010000:3.0:1787388245.328644:0:19426:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1787388245.328746:0:19426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787388245.328798:0:19426:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787388245.328809:0:19426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x26817551a44758a8 00000100:00080000:3.0:1787388245.328817:0:19426:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787388245.328823:0:19426:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff996a420b0000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1787388245.328853:0:19426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7c0c8e00 x1874211945777024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787388245.328884:0:19426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787388245.331706:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1874211945777024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787388245.333152:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874211945776768:12345-0@lo:400:kworker.0 Request processed in 5853us (6465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.333165:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787388245.333210:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787388245.333224:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945776896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.333275:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945776896:12345-0@lo:400:kworker.0 Request processed in 57us (6511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.333282:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787388245.333340:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f58ed80 x1874211945776384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787388261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388245.333386:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945776384:0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.333405:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945776000:0@lo:400:kworker.0 00010000:00080000:2.0:1787388245.333417:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f58f480 x1874211945776640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388245.333425:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945776640:0@lo:400:kworker.0 00000100:00100000:2.0:1787388245.333466:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945776256:0@lo:400:kworker.0 00010000:00080000:2.0:1787388245.333478:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f58ea00 x1874211945776896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388245.333487:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945776896:0@lo:400:kworker.0 00010000:00080000:2.0:1787388245.333499:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f58dc00 x1874211945776128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388245.333508:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874211945776128:0@lo:400:kworker.0 00010000:00080000:2.0:1787388245.333518:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f58df80 x1874211945776768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388245.333526:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1874211945776768:0@lo:400:kworker.0 00000100:00080000:2.0:1787388245.333550:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388245.333555:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388245.333558:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388245.335592:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388245.335600:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787388245.335603:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787388245.335606:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787388245.335772:0:19426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1787388245.337160:0:19413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787388245.337213:0:19413:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787388245.337235:0:19413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5cc00/0x26817551a447587e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475885 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388245.337248:0:19413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5cc00/0x26817551a447587e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475885 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787388245.337313:0:19413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787388245.337315:0:19413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787388245.337316:0:19413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388245.337318:0:19413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388245.337319:0:19413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388245.337321:0:19413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388245.337322:0:19413:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787388245.337324:0:19413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388245.337326:0:19413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787388245.337330:0:19413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787388245.337332:0:19413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787388245.337333:0:19413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787388245.337334:0:19413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388245.337335:0:19413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388245.337336:0:19413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388245.337337:0:19413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388245.337339:0:19413:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787388245.337340:0:19413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388245.337341:0:19413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787388245.337382:0:19413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787388245.337401:0:19413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945777152:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787388245.337469:0:19413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.337505:0:19413:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b461de6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787388245.338105:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945777152 00000100:00100000:0.0:1787388245.338113:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945777152 00000100:00100000:0.0:1787388245.338495:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787388245.338507:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945777152:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787388245.338534:0:17089:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787388245.338549:0:17089:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787388245.338697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388245.338728:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945777024 00000100:00100000:0.0:1787388245.338732:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945777024 00000100:00100000:0.0:1787388245.338756:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787388245.338762:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874211945777024:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787388245.338785:0:17095:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:0.0:1787388245.338819:0:17095:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x26817551a44758af 00000004:00100000:0.0:1787388245.338834:0:17095:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787388245.338864:0:17095:0:(import.c:65:import_set_state_nolock()) ffff996a42cc0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388245.338909:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874211945777024:12345-0@lo:38:llog_process_th.0 Request processed in 146us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388245.338917:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787388245.338994:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7c0c8e00 x1874211945777024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787388255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388245.339018:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787388245.339025:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787388245.339033:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787388245.339037:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787388245.339040:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a420b0000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787388245.339046:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1874211945777024:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1787388245.347084:0:17089:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787388245.347107:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787388245.347407:0:17110:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787388245.347412:0:17110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787388245.347435:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.347466:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a432f7a00/0x26817551a447582a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475823 expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.347474:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a432f6a00/0x26817551a4475838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475831 expref: 24 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.347481:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.347521:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a432f6a00/0x26817551a4475838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4475831 expref: 24 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.347535:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a432f6a00/0x26817551a4475838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4475831 expref: 24 pid: 17087 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388245.347550:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945777280:0@lo:104: 00000100:00100000:2.0:1787388245.347612:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787388245.347658:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a432f7a00/0x26817551a447582a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4475823 expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.347666:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a432f7a00/0x26817551a447582a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4475823 expref: 24 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388245.347675:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945777408:0@lo:104: 00000100:00100000:2.0:1787388245.347696:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.347714:0:17110:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b587f4240 going to sleep for 11 seconds 00000100:00100000:2.0:1787388245.347737:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945777280 00000100:00100000:2.0:1787388245.347743:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945777280 00000100:00100000:2.0:1787388245.347773:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945777408 00000100:00100000:2.0:1787388245.347782:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945777408 00000100:00100000:2.0:1787388245.347799:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787388245.347806:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+4:17110:x1874211945777280:12345-0@lo:104: 00010000:00010000:2.0:1787388245.347818:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.347871:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388245.347877:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+4:17110:x1874211945777280:12345-0@lo:104: Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.347884:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787388245.347901:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787388245.347907:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:17110:x1874211945777408:12345-0@lo:104: 00010000:00010000:2.0:1787388245.347915:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.347946:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787388245.347951:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:17110:x1874211945777408:12345-0@lo:104: Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388245.348102:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945777280:0@lo:104: 00000100:00100000:1.0:1787388245.348112:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874211945777408:0@lo:104: 00010000:00010000:1.0:1787388245.348131:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388245.348279:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:19413:x1874211945777152:12345-0@lo:253:mount.lustre.0 Request processed in 9775us (10808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388245.348297:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787388245.348341:0:19413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae525cec-d184-4a5a-bf65-8c20a2a658d5:19413:1874211945777152:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787388245.348368:0:19413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787388245.348371:0:19413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787388245.348373:0:19413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787388245.348374:0:19413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787388245.348375:0:19413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787388245.348377:0:19413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787388245.348378:0:19413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787388245.348379:0:19413:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787388245.348381:0:19413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787388245.348383:0:19413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787388245.348393:0:19413:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787388245.349300:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787388245.349336:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388245.349342:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.349365:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388245.349370:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.349379:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388245.349401:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388245.349407:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787388245.349446:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.349453:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388245.349474:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.349481:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b52f4f200/0x26817551a4475831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475838 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.349492:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388245.349495:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.349500:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6200 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388245.349503:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.349509:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388245.349515:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388245.349520:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787388245.349540:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.349545:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388245.349551:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.349556:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a432f6200/0x26817551a4475823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447582a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.349570:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388245.349571:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388245.349573:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388245.349580:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388245.349599:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3651:1874211945777536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388245.349651:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.349680:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388245.349686:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3651:1874211945777664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388245.349704:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388245.349736:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945777536 00000100:00100000:2.0:1787388245.349742:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945777536 00010000:00010000:2.0:1787388245.349763:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a432f6a00/0x26817551a4475838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475831 expref: 24 pid: 17087 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388245.351383:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945777664 00000100:00100000:2.0:1787388245.351394:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945777664 00010000:00010000:2.0:1787388245.351421:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a432f7a00/0x26817551a447582a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475823 expref: 25 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388245.351452:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787388245.351460:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+25:3651:x1874211945777536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388245.351484:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388245.351490:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a432f6a00/0x26817551a4475838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475831 expref: 25 pid: 17087 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351502:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a432f6a00/0x26817551a4475838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4475831 expref: 25 pid: 17087 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351517:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a432f6a00/0x26817551a4475838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4475831 expref: 25 pid: 17087 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351529:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388245.351584:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3651:x1874211945777536:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.351591:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787388245.351607:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787388245.351612:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:3651:x1874211945777664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388245.351620:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388245.351624:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a432f7a00/0x26817551a447582a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475823 expref: 23 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351631:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a432f7a00/0x26817551a447582a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4475823 expref: 23 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351640:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a432f7a00/0x26817551a447582a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4475823 expref: 23 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351649:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351657:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787388245.351678:0:17080:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010244960s 00010000:00010000:2.0:1787388245.351683:0:17080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351689:0:17080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351695:0:17080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351702:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351708:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5de00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388245.351712:0:17080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351721:0:17080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351748:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388245.351846:0:17110:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388245.351855:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351952:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b52f5de00/0x26817551a44758b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388245.351976:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388245.352004:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:3651:x1874211945777664:12345-0@lo:103:ldlm_bl.0 Request processed in 391us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388245.352010:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787388245.352056:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3651:1874211945777664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388245.352066:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3651:1874211945777536:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1787388245.362710:0:19413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787388245.366045:0:19413:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787388245.366055:0:19413:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787388245.366091:0:19413:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787388245.366153:0:19413:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787388245.366173:0:19413:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787388245.366339:0:19413:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787388245.368507:0:19413:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787388245.368744:0:19413:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787388245.741653:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945777792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787388245.741721:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388245.741814:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945777792 00000100:00100000:1.0:1787388245.741822:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945777792 00000100:00100000:1.0:1787388245.741874:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787388245.741884:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945777792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388245.741911:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787388245.741954:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945777792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388245.741972:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787388245.742681:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996b7f58f100 x1874211945777792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388245.742700:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945777792:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787388246.013035:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388246.383858:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388226/real 1787388226] req@ffff996b738e9500 x1874211945765248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388246 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388246.383887:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b738e9500 x1874211945765248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388246 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388246.383897:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787388226/real 1787388226] req@ffff996b738e8000 x1874211945765376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388246 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388246.383908:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996b738e8000 x1874211945765376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787388246 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787388246.383928:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5ddfe000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787388246.383946:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787388246.383950:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945765248:0@lo:8:kworker.0 00000100:00080000:2.0:1787388246.383956:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a42fcb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787388246.383971:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787388246.383974:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945765376:0@lo:8:kworker.0 00000100:00080000:2.0:1787388246.384286:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388246.384291:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787388246.384293:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996b5ddfe000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787388246.384298:0:16499:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:2.0:1787388246.384304:0:16499:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787388246.384310:0:16499:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff996b5ddfe000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787388246.384330:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f5e1500 x1874211945778176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787388246.384342:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388246.384365:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787388246.384367:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996a42fcb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787388246.384369:0:16499:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:2.0:1787388246.384372:0:16499:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787388246.384375:0:16499:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff996a42fcb800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787388246.384386:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996b7f5e0000 x1874211945778304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787388246.384481:0:16499:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787388246.384485:0:16499:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787388246.384487:0:16499:0:(import.c:65:import_set_state_nolock()) ffff996a43023800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787388246.384492:0:16499:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff996a43023800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1787388246.384503:0:16499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996a43a40000 x1874211945778688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787388246.384550:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945777920:0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.384609:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.385894:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945778816:0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.385939:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.385973:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945779328:0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.386000:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.386025:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787388246.386033:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945778560:0@lo:400:kworker.0 00000100:00100000:3.0:1787388246.387192:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945778176:0@lo:8:kworker.0 00000100:00100000:3.0:1787388246.393288:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388246.393337:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945778304:0@lo:8:kworker.0 00000100:00100000:1.0:1787388246.393738:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945778176 00000100:00100000:1.0:1787388246.393747:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945778176 00000100:00100000:1.0:1787388246.393786:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787388246.393793:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1874211945778176:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787388246.393825:0:18600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:1.0:1787388246.393869:0:18600:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a44758bd 00002000:00100000:1.0:1787388246.393883:0:18600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff996a441d2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787388246.393895:0:18600:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787388246.393898:0:18600:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787388246.393981:0:18600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787388246.394006:0:18600:0:(import.c:65:import_set_state_nolock()) ffff996a441d4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787388246.394547:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874211945778176:12345-0@lo:8:kworker.0 Request processed in 751us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388246.394556:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787388246.397019:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.397065:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945779200:0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.397111:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.397149:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945777920 00000100:00100000:2.0:1787388246.397156:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945777920 00000100:00100000:2.0:1787388246.398383:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787388246.398397:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:3650:x1874211945777920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.398469:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:3650:x1874211945777920:12345-0@lo:400:kworker.0 Request processed in 76us (13859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.398476:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787388246.398517:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945778816 00000100:00100000:2.0:1787388246.398523:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945778816 00000100:00100000:2.0:1787388246.398544:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945779328 00000100:00100000:2.0:1787388246.398547:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945779328 00000100:00100000:2.0:1787388246.398586:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945779200 00000100:00100000:2.0:1787388246.398590:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945779200 00000100:00100000:2.0:1787388246.398608:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787388246.398614:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945778816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.398760:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945778816:12345-0@lo:400:kworker.0 Request processed in 146us (12821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.398767:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787388246.398786:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787388246.398792:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945779328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.399032:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945779328:12345-0@lo:400:kworker.0 Request processed in 240us (13030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.399039:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787388246.399051:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787388246.399057:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945779200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.399087:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945779200:12345-0@lo:400:kworker.0 Request processed in 30us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.399093:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787388246.399118:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945778560 00000100:00100000:2.0:1787388246.399123:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945778560 00000100:00100000:2.0:1787388246.399149:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787388246.399155:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945778560:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787388246.399208:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787388246.399212:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388246.399215:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945778560:12345-0@lo:400:kworker.0 Request processed in 59us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.399221:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787388246.399287:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945778560:0@lo:400:kworker.0 00010000:00080000:2.0:1787388246.399303:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a41f80 x1874211945779200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388246.399313:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945779200:0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.399322:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945777920:0@lo:400:kworker.0 00010000:00080000:2.0:1787388246.399333:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a41c00 x1874211945778816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388246.399384:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945778816:0@lo:400:kworker.0 00010000:00080000:2.0:1787388246.399397:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a40700 x1874211945779328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388246.399405:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945779328:0@lo:400:kworker.0 00000100:00100000:0.0:1787388246.399895:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945778432:0@lo:400:kworker.0 00000100:00100000:0.0:1787388246.399937:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388246.399979:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945779072:0@lo:400:kworker.0 00000100:00100000:0.0:1787388246.400006:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388246.400026:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787388246.400033:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945778048:0@lo:400:kworker.0 00000100:00100000:0.0:1787388246.400073:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388246.400090:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945778944:0@lo:400:kworker.0 00000100:00100000:0.0:1787388246.400112:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.402315:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945778432 00000100:00100000:2.0:1787388246.402328:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945778432 00000100:00100000:2.0:1787388246.402387:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945779072 00000100:00100000:2.0:1787388246.402391:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945779072 00000100:00100000:2.0:1787388246.402406:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945778944 00000100:00100000:2.0:1787388246.402410:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945778944 00000100:00100000:2.0:1787388246.402424:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787388246.402433:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945778432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.402532:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945778432:12345-0@lo:400:kworker.0 Request processed in 99us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.402540:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787388246.402557:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787388246.402562:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945779072:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787388246.402576:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a41880 x1874211945778432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388246.402591:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945778432:0@lo:400:kworker.0 00000100:00100000:2.0:1787388246.402603:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945779072:12345-0@lo:400:kworker.0 Request processed in 41us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.402609:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787388246.402620:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787388246.402626:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945778944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388246.402655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.402661:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945778944:12345-0@lo:400:kworker.0 Request processed in 36us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.402679:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787388246.402693:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945778304 00000100:00100000:3.0:1787388246.402696:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945778304 00000100:00100000:2.0:1787388246.402701:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945778048 00000100:00100000:2.0:1787388246.402705:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945778048 00000100:00100000:3.0:1787388246.402719:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787388246.402724:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787388246.402730:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1874211945778304:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787388246.402730:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945778048:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787388246.402756:0:19184:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000100:00100000:2.0:1787388246.402760:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945778048:12345-0@lo:400:kworker.0 Request processed in 30us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.402765:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00000080:3.0:1787388246.402783:0:19184:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26817551a44758c4 00002000:00100000:3.0:1787388246.402798:0:19184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff996b482a2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787388246.402802:0:19184:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787388246.402805:0:19184:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787388246.402982:0:19184:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787388246.403004:0:19184:0:(import.c:65:import_set_state_nolock()) ffff996b482a6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388246.403041:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874211945778304:12345-0@lo:8:kworker.0 Request processed in 308us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388246.403046:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787388246.403112:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f5e0000 x1874211945778304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787388271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388246.403119:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787388246.403125:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787388246.404554:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787388246.404565:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787388246.404569:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a42fcb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787388246.404599:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787388246.404609:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945778304:0@lo:8:kworker.0 00000100:00100000:3.0:1787388246.404622:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945778688:0@lo:8:kworker.0 00000100:00100000:3.0:1787388246.404739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388246.404774:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945778688 00000100:00100000:3.0:1787388246.404781:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945778688 00000100:00100000:3.0:1787388246.404811:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787388246.404818:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1874211945778688:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787388246.404859:0:18600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:3.0:1787388246.404886:0:18600:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26817551a44758cb 00002000:00100000:3.0:1787388246.404898:0:18600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff996b482a3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787388246.404902:0:18600:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787388246.404905:0:18600:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787388246.404955:0:18600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787388246.404986:0:18600:0:(import.c:65:import_set_state_nolock()) ffff996b482a4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388246.405024:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1874211945778688:12345-0@lo:8:kworker.0 Request processed in 205us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388246.405032:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787388246.405273:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a40000 x1874211945778688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787388271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787388246.405288:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787388246.405295:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787388246.405298:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787388246.405300:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996a43023800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787388246.405313:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787388246.405317:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1874211945778688:0@lo:8:kworker.0 00000004:00080000:3.0:1787388246.405365:0:17837:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787388246.405519:0:17121:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1787388246.405539:0:17121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17121:1874211945779584:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787388246.405575:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.405594:0:17121:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b584269c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787388246.405615:0:17838:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787388246.405627:0:17838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17838:1874211945779840:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787388246.405661:0:17838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.405676:0:17838:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a42d55000 going to sleep for 11 seconds 00000100:00100000:2.0:1787388246.405688:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945779456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388246.405710:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.405729:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388246.405735:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945779712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388246.405754:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.405779:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945779584 00000100:00100000:2.0:1787388246.405784:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945779584 00000100:00100000:2.0:1787388246.405820:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945779840 00000100:00100000:2.0:1787388246.405823:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945779840 00000100:00100000:2.0:1787388246.405844:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388246.405860:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17121:x1874211945779584:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787388246.406510:0:17837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 567929161988ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787388246.406518:0:17837:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:3.0:1787388246.409025:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f5e1500 x1874211945778176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787388271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388246.409040:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787388246.409187:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787388246.409199:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787388246.409215:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787388246.409218:0:3648:0:(import.c:65:import_set_state_nolock()) ffff996b5ddfe000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787388246.409243:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787388246.409249:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1874211945778176:0@lo:8:kworker.0 00000004:00080000:3.0:1787388246.409307:0:17118:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787388246.409481:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787388246.409498:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17838:x1874211945779840:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787388246.409913:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945779456 00000100:00100000:2.0:1787388246.409922:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945779456 00000100:00100000:2.0:1787388246.409954:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945779712 00000100:00100000:2.0:1787388246.409967:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945779712 00000100:00100000:2.0:1787388246.409985:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787388246.409991:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874211945779456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388246.410005:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000004:00080000:3.0:1787388246.410180:0:17118:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567932832628ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787388246.410188:0:17118:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1787388246.410801:0:17119:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787388246.410824:0:17119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17119:1874211945780096:0@lo:5:osp-pre-0-0.0 00010000:00080000:0.0:1787388246.411598:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a41500 x1874211945779072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388246.411613:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945779072:0@lo:400:kworker.0 00000100:00100000:0.0:1787388246.411667:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945778048:0@lo:400:kworker.0 00010000:00080000:0.0:1787388246.411679:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a43480 x1874211945778944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388246.411687:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945778944:0@lo:400:kworker.0 00000004:00080000:0.0:1787388246.411713:0:17120:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787388246.411781:0:17120:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567934433848ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787388246.411787:0:17120:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:3.0:1787388246.412211:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388246.412372:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787388246.415369:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945779968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388246.416210:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388246.416247:0:17119:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a422d4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388246.417296:0:18599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787388246.417309:0:18599:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787388246.417866:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945780096 00000100:00100000:1.0:1787388246.417875:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945780096 00000100:00100000:1.0:1787388246.418003:0:19466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388246.418013:0:19466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17119:x1874211945780096:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787388246.421205:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874211945779456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11205us (15485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.421220:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787388246.421255:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787388246.421266:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874211945779712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388246.421290:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:2.0:1787388246.421341:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874211945779712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (15586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.421362:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:2.0:1787388246.421710:0:19184:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787388246.421717:0:19184:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787388246.421722:0:19184:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00010000:00080000:1.0:1787388246.425063:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a41180 x1874211945779712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388246.425090:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945779712:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787388246.425104:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43a40700 x1874211945779456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388246.425115:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945779456:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1787388246.426306:0:19466:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787388246.426319:0:19466:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787388246.426326:0:19466:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00080000:0.0:1787388246.430557:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388246.432365:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787388246.432922:0:17827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787388246.436298:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945779968 00000100:00100000:0.0:1787388246.436311:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945779968 00000100:00100000:0.0:1787388246.436374:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787388246.436384:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874211945779968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787388246.437168:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787388246.437262:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874211945779968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 879us (4917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388246.437271:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787388246.437339:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f58ca80 x1874211945779968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787388262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388246.437381:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945779968:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1787388246.440662:0:17075:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787388246.440682:0:17075:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787388246.443051:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388246.443063:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000631ec2b/0x26817551a44758d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.443091:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1787388246.443095:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388246.443101:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000631ec2b/0x26817551a44758d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.443118:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000631ec2b/0x26817551a44758d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.443322:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000631ec2b/0x26817551a44758d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.443332:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000631ec2b/0x26817551a44758d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.443368:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787388246.444506:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787388246.444514:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c145ac2/0x26817551a44758d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.444525:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1787388246.444528:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388246.444533:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c145ac2/0x26817551a44758d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.444544:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c145ac2/0x26817551a44758d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.444563:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c145ac2/0x26817551a44758d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.444570:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c145ac2/0x26817551a44758d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.444585:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787388246.444596:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388246.444601:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000631ec2b/0x26817551a44758d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.444607:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5ce00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388246.444611:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000631ec2b/0x26817551a44758d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.444620:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000631ec2b/0x26817551a44758d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787388246.444700:0:18601:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787388246.444706:0:18601:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787388246.444787:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17838:x1874211945779840:12345-0@lo:7:osp-pre-1-1.0 Request processed in 35293us (39121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388246.444802:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787388246.445238:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388246.445495:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000631ec2b/0x26817551a44758d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.445506:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000631ec2b/0x26817551a44758d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.445522:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.445531:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.445532:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388246.445571:0:17838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17838:1874211945779840:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787388246.445584:0:17838:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787388246.445619:0:17838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17838:1874211945780224:0@lo:5:osp-pre-1-1.0 00002000:00010000:3.0:1787388246.445972:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388246.445980:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1e79dd3/0x26817551a44758e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.445990:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1787388246.445994:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388246.445999:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1e79dd3/0x26817551a44758e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.446010:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1e79dd3/0x26817551a44758e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.446020:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1e79dd3/0x26817551a44758e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.446039:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1e79dd3/0x26817551a44758e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.446056:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787388246.446368:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388246.446373:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a44758e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.446382:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1787388246.446386:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1787388246.446762:0:17838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.446793:0:17838:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388246.446819:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945780224 00000100:00100000:2.0:1787388246.446826:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945780224 00000100:00100000:2.0:1787388246.446869:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787388246.446877:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17838:x1874211945780224:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787388246.446903:0:18599:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787388246.446938:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17838:x1874211945780224:12345-0@lo:5:osp-pre-1-1.0 Request processed in 63us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.446944:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787388246.446978:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a44758e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.446993:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a44758e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.447002:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a44758e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.447010:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a44758e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.447020:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787388246.447550:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388246.447557:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44758ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.447573:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1787388246.447576:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388246.447581:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44758ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.447591:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44758ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.447600:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44758ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.447608:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44758ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.447618:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787388246.449258:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388246.449268:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000294a836/0x26817551a44758f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.449281:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1787388246.449285:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388246.449290:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000294a836/0x26817551a44758f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.449302:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000294a836/0x26817551a44758f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.449325:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000294a836/0x26817551a44758f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.449333:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000294a836/0x26817551a44758f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.449367:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1787388246.449569:0:17838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17838:1874211945780224:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787388246.449585:0:17838:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787388246.449624:0:17838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17838:1874211945780352:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787388246.449745:0:17838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.449771:0:17838:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388246.449787:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945780352 00000100:00100000:2.0:1787388246.449793:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945780352 00000100:00100000:2.0:1787388246.449831:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787388246.449839:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17838:x1874211945780352:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787388246.449873:0:18601:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:3.0:1787388246.451761:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787388246.451772:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1e79dd3/0x26817551a44758e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451785:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7200 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.451790:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1e79dd3/0x26817551a44758e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451800:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1e79dd3/0x26817551a44758e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451819:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1e79dd3/0x26817551a44758e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451827:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1e79dd3/0x26817551a44758e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451846:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787388246.451859:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a44758e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451865:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7000 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.451869:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a44758e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451877:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a44758e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451887:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a44758e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451894:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3f25a80/0x26817551a44758e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451906:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787388246.451910:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44758ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451916:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.451919:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44758ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451927:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44758ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451947:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44758ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451955:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095c4b728/0x26817551a44758ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451982:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.451986:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000294a836/0x26817551a44758f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.451993:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7e00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.451997:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000294a836/0x26817551a44758f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.452005:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000294a836/0x26817551a44758f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.452015:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000294a836/0x26817551a44758f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.452023:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000294a836/0x26817551a44758f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.452032:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.452034:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.452040:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787388246.458935:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388246.458949:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509382c4/0x26817551a44758fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.458975:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1787388246.458979:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388246.458986:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000509382c4/0x26817551a44758fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.459000:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000509382c4/0x26817551a44758fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.459008:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000509382c4/0x26817551a44758fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.459015:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000509382c4/0x26817551a44758fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.459042:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787388246.459889:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388246.459897:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000245fe62b/0x26817551a4475903 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.459907:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1787388246.459910:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388246.459915:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000245fe62b/0x26817551a4475903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.459939:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000245fe62b/0x26817551a4475903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.459949:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000245fe62b/0x26817551a4475903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.459968:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000245fe62b/0x26817551a4475903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.459978:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787388246.460173:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787388246.460180:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000509382c4/0x26817551a44758fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460189:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6e00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.460194:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000509382c4/0x26817551a44758fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460202:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000509382c4/0x26817551a44758fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460218:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000509382c4/0x26817551a44758fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460226:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000509382c4/0x26817551a44758fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460255:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c145ac2/0x26817551a44758d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460262:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5de00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.460266:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c145ac2/0x26817551a44758d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460273:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c145ac2/0x26817551a44758d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460284:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c145ac2/0x26817551a44758d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460291:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c145ac2/0x26817551a44758d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460303:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.460307:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000245fe62b/0x26817551a4475903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460312:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.460316:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000245fe62b/0x26817551a4475903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460322:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000245fe62b/0x26817551a4475903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460341:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000245fe62b/0x26817551a4475903 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460369:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000245fe62b/0x26817551a4475903 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.460384:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.460386:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.460388:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.461662:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.462216:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.462218:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.462220:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.462541:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.462550:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a447590a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.462563:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787388246.462567:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.462573:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a447590a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.462586:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a447590a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.462597:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a447590a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.462605:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a447590a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.462623:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388246.463733:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.463742:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a447590a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.463753:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031200 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.463758:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a447590a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.463766:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a447590a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.463783:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a447590a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.463803:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6030f73/0x26817551a447590a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.463825:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.463827:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.463828:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.465054:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.465063:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a4475911 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.465076:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787388246.465080:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.465092:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a4475911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.465106:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a4475911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.465116:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a4475911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.465124:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a4475911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.465205:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787388246.465522:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388246.465535:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a4475911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.465544:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388246.465548:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a4475911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.465557:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a4475911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.465571:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a4475911 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.465579:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008df024b6/0x26817551a4475911 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.465596:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.465598:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.465600:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.466805:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.466815:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032702a10/0x26817551a4475918 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.466827:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787388246.466830:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.466835:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032702a10/0x26817551a4475918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.466845:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032702a10/0x26817551a4475918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.466854:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032702a10/0x26817551a4475918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.466872:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032702a10/0x26817551a4475918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.466894:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388246.467035:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388246.467042:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032702a10/0x26817551a4475918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.467050:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031c00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.467054:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032702a10/0x26817551a4475918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.467063:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032702a10/0x26817551a4475918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.467077:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032702a10/0x26817551a4475918 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.467085:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032702a10/0x26817551a4475918 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.467101:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.467103:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.467104:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.469582:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.469600:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be1f7a45/0x26817551a447591f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.469615:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787388246.469620:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.469625:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be1f7a45/0x26817551a447591f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.469705:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be1f7a45/0x26817551a447591f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.469715:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be1f7a45/0x26817551a447591f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.469722:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be1f7a45/0x26817551a447591f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.469744:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787388246.469935:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388246.469942:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be1f7a45/0x26817551a447591f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.469951:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030e00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388246.469966:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1f7a45/0x26817551a447591f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.469988:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1f7a45/0x26817551a447591f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.470004:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be1f7a45/0x26817551a447591f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.470011:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be1f7a45/0x26817551a447591f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.470031:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.470033:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.470035:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.470871:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.470879:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaff4262/0x26817551a4475926 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.470889:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787388246.470892:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.470897:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaff4262/0x26817551a4475926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.470907:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaff4262/0x26817551a4475926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.470922:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaff4262/0x26817551a4475926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.470929:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaff4262/0x26817551a4475926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.470942:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787388246.471091:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388246.471098:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaff4262/0x26817551a4475926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.471106:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030200 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388246.471110:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaff4262/0x26817551a4475926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.471118:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaff4262/0x26817551a4475926 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.471136:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaff4262/0x26817551a4475926 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.471157:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaff4262/0x26817551a4475926 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.471173:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.471176:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.471177:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787388246.472944:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388246.472983:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009512468b/0x26817551a447592d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.472998:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1787388246.473002:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388246.473008:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009512468b/0x26817551a447592d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.473020:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009512468b/0x26817551a447592d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.473030:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009512468b/0x26817551a447592d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.473037:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009512468b/0x26817551a447592d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.473057:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787388246.473507:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388246.473515:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009512468b/0x26817551a447592d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.473524:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388246.473529:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009512468b/0x26817551a447592d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.473538:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009512468b/0x26817551a447592d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.473554:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009512468b/0x26817551a447592d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.473561:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009512468b/0x26817551a447592d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.473579:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.473581:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.473583:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.476749:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.476760:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ebb02e9/0x26817551a4475934 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.476776:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787388246.476780:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.476786:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ebb02e9/0x26817551a4475934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.476800:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ebb02e9/0x26817551a4475934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.476809:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ebb02e9/0x26817551a4475934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.476818:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ebb02e9/0x26817551a4475934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.476850:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388246.477058:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.477071:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ebb02e9/0x26817551a4475934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.477079:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.477084:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ebb02e9/0x26817551a4475934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.477092:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ebb02e9/0x26817551a4475934 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.477108:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ebb02e9/0x26817551a4475934 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.477115:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ebb02e9/0x26817551a4475934 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.477140:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.477142:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.477144:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.477619:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.477644:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a447593b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.477654:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787388246.477656:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.477661:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a447593b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.477675:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a447593b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.477684:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a447593b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.477691:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a447593b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.477709:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388246.478024:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.478030:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a447593b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.478040:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4f200 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.478044:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a447593b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.478066:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a447593b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.478081:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a447593b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.478089:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f0d358e/0x26817551a447593b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.478105:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.478107:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.478109:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.478192:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.478199:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad64f2fa/0x26817551a4475942 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.478207:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1787388246.478209:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.478213:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad64f2fa/0x26817551a4475942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.478222:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad64f2fa/0x26817551a4475942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.478236:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad64f2fa/0x26817551a4475942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.478243:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad64f2fa/0x26817551a4475942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.478264:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787388246.478855:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.478863:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b56e3a5b/0x26817551a4475949 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.478873:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.478876:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.478880:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b56e3a5b/0x26817551a4475949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.478891:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b56e3a5b/0x26817551a4475949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.478899:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b56e3a5b/0x26817551a4475949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.478905:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b56e3a5b/0x26817551a4475949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.478921:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787388246.479018:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787388246.479023:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad64f2fa/0x26817551a4475942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.479031:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076e00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.479039:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad64f2fa/0x26817551a4475942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.479047:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad64f2fa/0x26817551a4475942 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.479060:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad64f2fa/0x26817551a4475942 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.479066:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad64f2fa/0x26817551a4475942 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.479080:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388246.479084:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b56e3a5b/0x26817551a4475949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.479089:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40031600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.479092:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b56e3a5b/0x26817551a4475949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.479098:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b56e3a5b/0x26817551a4475949 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.479106:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b56e3a5b/0x26817551a4475949 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.479114:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b56e3a5b/0x26817551a4475949 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.479135:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.479136:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.479138:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.479552:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.481628:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1787388246.481912:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.481922:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee709b12/0x26817551a4475957 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.481936:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.481940:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.481945:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee709b12/0x26817551a4475957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.482113:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efc221c6/0x26817551a4475950 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.482121:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.482124:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.482128:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efc221c6/0x26817551a4475950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.482146:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efc221c6/0x26817551a4475950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.482155:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efc221c6/0x26817551a4475950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.482163:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efc221c6/0x26817551a4475950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.482196:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388246.483723:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.483733:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efc221c6/0x26817551a4475950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.483744:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076000 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.483749:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efc221c6/0x26817551a4475950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.483759:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efc221c6/0x26817551a4475950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.483780:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efc221c6/0x26817551a4475950 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.483795:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efc221c6/0x26817551a4475950 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.483814:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.483816:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.483818:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.484201:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.484209:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d433a83/0x26817551a447595e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.484219:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.484222:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.484228:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d433a83/0x26817551a447595e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.484239:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d433a83/0x26817551a447595e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.484247:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d433a83/0x26817551a447595e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.484254:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d433a83/0x26817551a447595e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.484278:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388246.484715:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.484722:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d433a83/0x26817551a447595e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.484730:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076200 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.484734:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d433a83/0x26817551a447595e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.484742:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d433a83/0x26817551a447595e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.484755:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d433a83/0x26817551a447595e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.484762:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d433a83/0x26817551a447595e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.484778:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.484779:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.484781:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.484907:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee709b12/0x26817551a4475957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.484917:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee709b12/0x26817551a4475957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.484924:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee709b12/0x26817551a4475957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.484943:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787388246.485413:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.485419:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e472e2b/0x26817551a4475965 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.485438:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.485441:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.485446:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e472e2b/0x26817551a4475965 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.485456:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e472e2b/0x26817551a4475965 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.485464:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e472e2b/0x26817551a4475965 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.485471:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e472e2b/0x26817551a4475965 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.485489:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787388246.485844:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787388246.485850:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee709b12/0x26817551a4475957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.485858:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09c00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.485868:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee709b12/0x26817551a4475957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.485876:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee709b12/0x26817551a4475957 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.485890:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee709b12/0x26817551a4475957 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.485898:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee709b12/0x26817551a4475957 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.485915:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388246.485919:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e472e2b/0x26817551a4475965 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.485926:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.485930:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e472e2b/0x26817551a4475965 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.485938:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e472e2b/0x26817551a4475965 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.485948:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e472e2b/0x26817551a4475965 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.485965:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e472e2b/0x26817551a4475965 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.485985:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.485986:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.485989:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.486105:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.486333:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.486339:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f00fcba2/0x26817551a447596c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.486371:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.486374:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.486379:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f00fcba2/0x26817551a447596c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.486454:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f00fcba2/0x26817551a447596c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.486476:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f00fcba2/0x26817551a447596c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.486483:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f00fcba2/0x26817551a447596c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.486499:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787388246.486899:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.486905:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2798b91/0x26817551a4475973 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.486913:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.486916:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.486921:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2798b91/0x26817551a4475973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.486929:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2798b91/0x26817551a4475973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.486935:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2798b91/0x26817551a4475973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.486941:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2798b91/0x26817551a4475973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.486973:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787388246.487123:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787388246.487135:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f00fcba2/0x26817551a447596c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487143:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.487147:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f00fcba2/0x26817551a447596c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487155:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f00fcba2/0x26817551a447596c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487167:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f00fcba2/0x26817551a447596c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487175:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f00fcba2/0x26817551a447596c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487191:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.487194:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2798b91/0x26817551a4475973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487200:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.487202:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2798b91/0x26817551a4475973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487209:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2798b91/0x26817551a4475973 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487226:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2798b91/0x26817551a4475973 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487234:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2798b91/0x26817551a4475973 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487247:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.487249:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.487251:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.487304:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.487410:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.487416:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863f19ef/0x26817551a447597a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.487424:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.487427:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.487431:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863f19ef/0x26817551a447597a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.487440:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863f19ef/0x26817551a447597a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.487446:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863f19ef/0x26817551a447597a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.487452:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863f19ef/0x26817551a447597a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.487468:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388246.487881:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.487886:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863f19ef/0x26817551a447597a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487894:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077200 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.487898:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863f19ef/0x26817551a447597a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487905:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863f19ef/0x26817551a447597a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487917:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863f19ef/0x26817551a447597a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487924:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863f19ef/0x26817551a447597a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.487951:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.487953:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.487954:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.488628:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.489087:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000929eb7e6/0x26817551a4475981 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.489110:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.489114:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.489119:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000929eb7e6/0x26817551a4475981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.489135:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000929eb7e6/0x26817551a4475981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.489145:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000929eb7e6/0x26817551a4475981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.489153:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000929eb7e6/0x26817551a4475981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.489175:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787388246.489316:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.489322:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a4475988 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.489330:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.489333:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.489337:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a4475988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.489374:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a4475988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.489909:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.489916:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000929eb7e6/0x26817551a4475981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.489926:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076c00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.489930:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000929eb7e6/0x26817551a4475981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.489939:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000929eb7e6/0x26817551a4475981 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.489954:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000929eb7e6/0x26817551a4475981 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.489971:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000929eb7e6/0x26817551a4475981 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.489990:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.489992:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.489994:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.491501:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a4475988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.491512:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a4475988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.491532:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388246.491543:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388246.491549:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a4475988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.491557:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.491562:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a4475988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.491571:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a4475988 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.491586:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a4475988 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.491593:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a4475988 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.491609:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.491618:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.491620:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.493060:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.493069:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b39ac4/0x26817551a447598f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.493084:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.493088:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.493095:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b39ac4/0x26817551a447598f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.493107:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015b39ac4/0x26817551a447598f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.493116:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b39ac4/0x26817551a447598f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.493123:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015b39ac4/0x26817551a447598f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.493154:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388246.493304:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.493311:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015b39ac4/0x26817551a447598f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.493330:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.493334:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b39ac4/0x26817551a447598f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.493342:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b39ac4/0x26817551a447598f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388246.493786:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.493794:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000652d967b/0x26817551a4475996 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.493803:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.493806:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.493811:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000652d967b/0x26817551a4475996 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.493820:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000652d967b/0x26817551a4475996 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.493828:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000652d967b/0x26817551a4475996 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.493835:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000652d967b/0x26817551a4475996 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.493850:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787388246.494000:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015b39ac4/0x26817551a447598f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.494008:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015b39ac4/0x26817551a447598f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.494025:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787388246.494029:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000652d967b/0x26817551a4475996 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.494037:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09e00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:3.0:1787388246.494041:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000652d967b/0x26817551a4475996 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.494048:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000652d967b/0x26817551a4475996 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.494058:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000652d967b/0x26817551a4475996 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.494072:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000652d967b/0x26817551a4475996 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.494086:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.494088:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.494090:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.494097:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.497120:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.497133:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e812f14/0x26817551a447599d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497149:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.497152:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.497158:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e812f14/0x26817551a447599d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497178:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e812f14/0x26817551a447599d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497189:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e812f14/0x26817551a447599d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497197:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e812f14/0x26817551a447599d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497213:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388246.497223:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388246.497228:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e812f14/0x26817551a447599d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497235:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.497239:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e812f14/0x26817551a447599d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497248:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e812f14/0x26817551a447599d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497262:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e812f14/0x26817551a447599d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497269:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e812f14/0x26817551a447599d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497290:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.497292:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.497294:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.497493:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.497499:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497508:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.497511:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.497516:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497525:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497533:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497541:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497555:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388246.497561:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388246.497565:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497582:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077000 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.497586:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497595:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497605:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497611:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.497623:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.497625:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.497626:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.501317:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.501330:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000921300de/0x26817551a44759ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.501374:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.501379:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.501386:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000921300de/0x26817551a44759ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.501514:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000921300de/0x26817551a44759ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.501532:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000921300de/0x26817551a44759ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.501540:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000921300de/0x26817551a44759ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.501560:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787388246.502000:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.502006:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005620d6a7/0x26817551a44759b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.502015:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.502018:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.502023:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005620d6a7/0x26817551a44759b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.502032:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005620d6a7/0x26817551a44759b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.502042:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005620d6a7/0x26817551a44759b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.502050:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005620d6a7/0x26817551a44759b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.502080:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787388246.502091:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787388246.502097:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000921300de/0x26817551a44759ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.502106:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.502110:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000921300de/0x26817551a44759ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.502121:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000921300de/0x26817551a44759ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502219:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388246.502225:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005620d6a7/0x26817551a44759b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502232:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.502242:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005620d6a7/0x26817551a44759b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502251:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005620d6a7/0x26817551a44759b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502268:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005620d6a7/0x26817551a44759b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502277:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005620d6a7/0x26817551a44759b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502294:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.502295:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.502297:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.502330:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000921300de/0x26817551a44759ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.502339:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000921300de/0x26817551a44759ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787388246.502785:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.502791:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e3c7e55/0x26817551a44759b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502802:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.502805:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.502810:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e3c7e55/0x26817551a44759b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502820:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e3c7e55/0x26817551a44759b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502828:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e3c7e55/0x26817551a44759b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502842:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e3c7e55/0x26817551a44759b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.502858:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388246.503476:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388246.503481:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e3c7e55/0x26817551a44759b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.503489:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09200 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.503493:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e3c7e55/0x26817551a44759b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.503514:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e3c7e55/0x26817551a44759b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.503528:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e3c7e55/0x26817551a44759b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.503535:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e3c7e55/0x26817551a44759b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.503549:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.503551:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.503553:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.503560:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.504383:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.504402:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebd8cf05/0x26817551a44759c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.504415:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.504420:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.504425:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd8cf05/0x26817551a44759c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.504436:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebd8cf05/0x26817551a44759c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.504446:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebd8cf05/0x26817551a44759c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.504454:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd8cf05/0x26817551a44759c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.504471:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388246.504480:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388246.504484:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebd8cf05/0x26817551a44759c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.504498:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.504503:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebd8cf05/0x26817551a44759c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.504511:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebd8cf05/0x26817551a44759c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.504523:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebd8cf05/0x26817551a44759c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.504532:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebd8cf05/0x26817551a44759c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.504547:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.504549:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.504551:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787388246.505276:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388246.505285:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000245fe62b/0x26817551a44759c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.505297:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=568s v=(0 0) 00010000:00010000:3.0:1787388246.505300:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388246.505305:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000245fe62b/0x26817551a44759c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.505315:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000245fe62b/0x26817551a44759c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.505324:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000245fe62b/0x26817551a44759c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.505332:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000245fe62b/0x26817551a44759c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.505372:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787388246.505925:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388246.505932:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a44759ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.505941:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=568s v=(0 0) 00010000:00010000:3.0:1787388246.505944:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388246.505948:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a44759ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.505967:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a44759ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.505976:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a44759ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.505982:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a44759ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787388246.509795:0:19184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.509807:0:19184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2b453d/0x26817551a44759d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.509822:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.509826:0:19184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.509833:0:19184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b2b453d/0x26817551a44759d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.509846:0:19184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b2b453d/0x26817551a44759d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.509857:0:19184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2b453d/0x26817551a44759d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.509871:0:19184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b2b453d/0x26817551a44759d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.510508:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787388246.511258:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787388246.511266:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000294a836/0x26817551a44759dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.511277:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=568s v=(0 0) 00010000:00010000:3.0:1787388246.511281:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388246.511285:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000294a836/0x26817551a44759dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.511307:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000294a836/0x26817551a44759dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.511316:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000294a836/0x26817551a44759dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388246.511323:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000294a836/0x26817551a44759dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511507:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787388246.511515:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000245fe62b/0x26817551a44759c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511523:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.511527:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000245fe62b/0x26817551a44759c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511536:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000245fe62b/0x26817551a44759c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511559:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000245fe62b/0x26817551a44759c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511566:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000245fe62b/0x26817551a44759c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511581:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787388246.511585:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a44759ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511592:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6e00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.511595:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a44759ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511603:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a44759ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511612:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a44759ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511618:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000509382c4/0x26817551a44759ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511628:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787388246.511643:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b2b453d/0x26817551a44759d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511655:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.511658:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2b453d/0x26817551a44759d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511664:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2b453d/0x26817551a44759d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511674:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b2b453d/0x26817551a44759d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511682:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388246.511685:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000294a836/0x26817551a44759dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511691:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7e00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.511694:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000294a836/0x26817551a44759dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511700:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000294a836/0x26817551a44759dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511709:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000294a836/0x26817551a44759dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.511716:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.511723:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.511726:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.514303:0:19184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787388246.514317:0:19184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b2b453d/0x26817551a44759d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.514377:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.516320:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787388246.518827:0:19414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787388246.518868:0:19414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787388246.518873:0:19414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00080000:0.0:1787388246.518991:0:19184:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1787388246.519077:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17121:x1874211945779584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 113214us (113497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388246.519087:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388246.519236:0:17121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17121:1874211945779584:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787388246.519252:0:17121:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1787388246.519295:0:17121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17121:1874211945780480:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787388246.519327:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.519379:0:17121:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517cec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388246.519536:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17838:x1874211945780352:12345-0@lo:5:osp-pre-1-1.0 Request processed in 69696us (69790us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787388246.519543:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787388246.519558:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945780480 00000100:00100000:2.0:1787388246.519562:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945780480 00000100:00100000:2.0:1787388246.519596:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787388246.519604:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17121:x1874211945780480:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787388246.519742:0:18601:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:3.0:1787388246.520096:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787388246.520106:0:19466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000294a836/0x26817551a44759dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388246.520545:0:17838:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787388246.520553:0:17838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a42300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17838:1874211945780352:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787388246.520565:0:17838:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787388246.520603:0:17838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17838:1874211945780608:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787388246.520713:0:17838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388246.520735:0:17838:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b6cdbad80 going to sleep for 11 seconds 00010000:00010000:0.0:1787388246.520789:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388246.521383:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945780608 00000100:00100000:2.0:1787388246.521717:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945780608 00000100:00100000:2.0:1787388246.521762:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787388246.521771:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17838:x1874211945780608:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787388246.521830:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17838:x1874211945780608:12345-0@lo:900:osp-pre-1-1.0 Request processed in 60us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.521837:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787388246.521870:0:17838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c0c9f80 x1874211945780608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787388262 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388246.521881:0:17838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17838:1874211945780608:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787388246.528580:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.528592:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.528607:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.528612:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.528618:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.528642:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.528652:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.528659:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.528694:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388246.528707:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388246.528712:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.528719:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077000 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.528724:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.528733:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.528749:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.528755:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa087001/0x26817551a44759e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.528774:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.528776:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.528777:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.534979:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.534992:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a44759ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.535007:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.535018:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.535024:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a44759ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.535039:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a44759ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.535049:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a44759ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.535058:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a44759ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.535081:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388246.535587:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388246.535593:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a44759ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.535603:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.535607:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a44759ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.535617:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a44759ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.535644:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a44759ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.535652:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000921300de/0x26817551a44759ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.535681:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.535683:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.535685:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.536882:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.536892:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd8cf05/0x26817551a44759f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.536905:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.536909:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.536915:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd8cf05/0x26817551a44759f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.536926:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebd8cf05/0x26817551a44759f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.536935:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd8cf05/0x26817551a44759f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.536943:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd8cf05/0x26817551a44759f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.536973:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787388246.537746:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.537753:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a44759f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.537774:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.537777:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.537781:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a44759f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.537791:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a44759f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.537799:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a44759f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.537806:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a44759f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.537821:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787388246.538186:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.538193:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a44759ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538201:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.538204:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.538209:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a44759ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538218:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a44759ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538237:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a44759ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538245:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a44759ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538261:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787388246.538270:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787388246.538275:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebd8cf05/0x26817551a44759f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538283:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.538287:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd8cf05/0x26817551a44759f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538297:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd8cf05/0x26817551a44759f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538312:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebd8cf05/0x26817551a44759f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538319:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebd8cf05/0x26817551a44759f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538336:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787388246.538363:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a44759f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538371:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08e00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.538374:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a44759f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538381:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a44759f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538571:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a44759f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538580:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a44759f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538595:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388246.538599:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a44759ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538605:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.538609:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a44759ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538617:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a44759ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538703:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a44759ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538711:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a44759ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.538725:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.538727:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.538729:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.539020:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.539026:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.539035:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.539038:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.539043:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.539053:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.539062:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.539070:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.539095:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388246.539103:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388246.539106:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.539113:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.539116:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.539124:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.539223:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.539230:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.539265:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.539274:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.539288:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.539290:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.539291:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.541459:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.541472:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e812f14/0x26817551a4475a0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.541488:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.541492:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.541498:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e812f14/0x26817551a4475a0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.541510:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e812f14/0x26817551a4475a0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.541533:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e812f14/0x26817551a4475a0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.541539:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e812f14/0x26817551a4475a0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.541561:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787388246.542713:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.542723:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006de16fa9/0x26817551a4475a14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542735:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.542738:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.542743:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006de16fa9/0x26817551a4475a14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542753:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006de16fa9/0x26817551a4475a14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542763:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006de16fa9/0x26817551a4475a14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542771:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006de16fa9/0x26817551a4475a14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542800:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787388246.542810:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787388246.542816:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e812f14/0x26817551a4475a0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542823:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.542828:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e812f14/0x26817551a4475a0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542836:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e812f14/0x26817551a4475a0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542852:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e812f14/0x26817551a4475a0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542860:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e812f14/0x26817551a4475a0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542877:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388246.542880:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006de16fa9/0x26817551a4475a14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542886:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077e00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.542889:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006de16fa9/0x26817551a4475a14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542908:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006de16fa9/0x26817551a4475a14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542920:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006de16fa9/0x26817551a4475a14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542928:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006de16fa9/0x26817551a4475a14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.542941:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.542943:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.542945:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388246.543506:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388246.544008:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17121:x1874211945780480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 24400us (24675us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787388246.544030:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787388246.544774:0:17121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17121:1874211945780480:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787388246.544790:0:17121:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00002000:00010000:1.0:1787388246.545488:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.545501:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b2b453d/0x26817551a4475a1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.545517:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.545520:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.545526:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b2b453d/0x26817551a4475a1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.545539:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b2b453d/0x26817551a4475a1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.545550:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b2b453d/0x26817551a4475a1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.545569:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b2b453d/0x26817551a4475a1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.545587:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787388246.546509:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388246.546517:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b2b453d/0x26817551a4475a1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.546527:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388246.546531:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b2b453d/0x26817551a4475a1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.546540:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b2b453d/0x26817551a4475a1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.546559:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b2b453d/0x26817551a4475a1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.546565:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b2b453d/0x26817551a4475a1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.546585:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.546587:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.546588:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.547257:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.547264:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007dbb88d/0x26817551a4475a22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.547275:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.547279:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.547283:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007dbb88d/0x26817551a4475a22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.547294:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007dbb88d/0x26817551a4475a22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.547301:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007dbb88d/0x26817551a4475a22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.547309:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007dbb88d/0x26817551a4475a22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.547334:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787388246.548799:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388246.548809:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007dbb88d/0x26817551a4475a22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.548821:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076400 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388246.548826:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007dbb88d/0x26817551a4475a22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.548844:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007dbb88d/0x26817551a4475a22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.548861:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007dbb88d/0x26817551a4475a22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.548870:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007dbb88d/0x26817551a4475a22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.548893:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.548895:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.548898:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787388246.549273:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787388246.549281:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e842ed83/0x26817551a4475a29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.549298:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1787388246.549301:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388246.549307:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e842ed83/0x26817551a4475a29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.549319:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e842ed83/0x26817551a4475a29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.549329:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e842ed83/0x26817551a4475a29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.549337:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e842ed83/0x26817551a4475a29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.549895:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787388246.550030:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388246.550037:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e842ed83/0x26817551a4475a29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.550047:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076a00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.550057:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e842ed83/0x26817551a4475a29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.550066:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e842ed83/0x26817551a4475a29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.550080:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e842ed83/0x26817551a4475a29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.550086:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e842ed83/0x26817551a4475a29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.550100:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.550101:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.550103:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.551729:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.551740:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059e34139/0x26817551a4475a30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.551753:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.551756:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.551761:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059e34139/0x26817551a4475a30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.551772:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059e34139/0x26817551a4475a30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.551779:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059e34139/0x26817551a4475a30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.551793:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059e34139/0x26817551a4475a30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.551817:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787388246.552301:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.552307:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bc33bba/0x26817551a4475a37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.552316:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.552319:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.552323:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bc33bba/0x26817551a4475a37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.552331:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bc33bba/0x26817551a4475a37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.552338:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bc33bba/0x26817551a4475a37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.552776:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787388246.552783:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059e34139/0x26817551a4475a30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.552793:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:2.0:1787388246.552798:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059e34139/0x26817551a4475a30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.552806:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059e34139/0x26817551a4475a30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.552823:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059e34139/0x26817551a4475a30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.552844:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059e34139/0x26817551a4475a30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.552860:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.552862:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388246.552864:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.563712:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bc33bba/0x26817551a4475a37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.564027:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787388246.565324:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.565334:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565373:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.565377:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.565383:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565467:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565477:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565484:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565503:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787388246.565514:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787388246.565520:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bc33bba/0x26817551a4475a37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565526:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09000 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.565531:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bc33bba/0x26817551a4475a37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565538:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bc33bba/0x26817551a4475a37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565566:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bc33bba/0x26817551a4475a37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565574:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bc33bba/0x26817551a4475a37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565590:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388246.565593:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565599:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08800 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388246.565602:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565610:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565618:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.565625:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051bc0546/0x26817551a4475a3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1787388246.565797:0:19481:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787388246.566086:0:19481:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787388246.566219:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.566220:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.566228:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.566762:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.566770:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a4475a45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.566781:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.566785:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.566790:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a4475a45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.566800:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a4475a45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.566808:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a4475a45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.566815:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a4475a45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.566841:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787388246.567002:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388246.567009:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a4475a45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.567017:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09600 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.567021:0:19469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a4475a45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.567029:0:19469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a4475a45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.567055:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a4475a45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.567063:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025504208/0x26817551a4475a45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.567078:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.567080:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.567082:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787388246.567884:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787388246.567893:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a4475a4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.567906:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1787388246.567909:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787388246.567914:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a4475a4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.568232:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388246.568531:0:19466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a4475a4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.568546:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a4475a4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388246.568555:0:19466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a4475a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.572584:0:19466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787388246.572752:0:19466:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:1.0:1787388246.572924:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388246.572934:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a4475a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.572963:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e08e00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388246.572969:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a4475a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.572979:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a4475a4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.572998:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a4475a4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.573005:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d06e40c9/0x26817551a4475a4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.573042:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.573044:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388246.573046:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388246.573141:0:19466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17119:x1874211945780096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 155114us (156919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.573152:0:19466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787388246.574800:0:17119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17119:1874211945780096:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787388246.574818:0:17119:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1787388246.574863:0:17119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17119:1874211945780736:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787388246.574912:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388246.574962:0:17119:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b6cdba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388246.575135:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945780736 00000100:00100000:2.0:1787388246.575143:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945780736 00000100:00100000:2.0:1787388246.575195:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787388246.575204:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17119:x1874211945780736:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787388246.575241:0:19184:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:3.0:1787388246.585173:0:18595:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1787388246.585220:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787388246.585552:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17119:x1874211945780736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10343us (10634us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787388246.585565:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787388246.585773:0:17119:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787388246.585781:0:17119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17119:1874211945780736:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787388246.585795:0:17119:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 10000000:01000000:2.0:1787388246.700579:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787388246.700586:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996b73a8a800 from 10 10000000:01000000:2.0:1787388246.700601:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787388246.700653:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5ce00/0x26817551a4475a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.700668:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b52f5ce00/0x26817551a4475a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.700680:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b52f5ce00/0x26817551a4475a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388246.700715:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945780864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388246.700781:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388246.700862:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388246.705276:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945780864 00000100:00100000:1.0:1787388246.705290:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945780864 00000100:00100000:1.0:1787388246.705363:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787388246.705374:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:17091:x1874211945780864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388246.705915:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388246.706012:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70077000/0x26817551a4475a5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475a53 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.706044:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077000/0x26817551a4475a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475a53 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.706055:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70077000/0x26817551a4475a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475a53 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.706065:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077000, rc 0) 00000100:00100000:1.0:1787388246.706223:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:17091:x1874211945780864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 845us (5435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388246.706232:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787388246.706300:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945780864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388246.706317:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b52f5ce00/0x26817551a4475a53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475a5a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.706328:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b52f5ce00/0x26817551a4475a53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475a5a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388246.707793:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945780992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787388246.707859:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388246.707904:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a43a5bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388246.708026:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945780992 00000100:00100000:3.0:1787388246.708034:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945780992 00000100:00100000:3.0:1787388246.708080:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787388246.708089:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:17091:x1874211945780992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787388246.708110:0:17087:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787388246.708145:0:17087:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787388246.708149:0:17087:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787388246.708231:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:17091:x1874211945780992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388246.708239:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787388246.709244:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945780992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787388246.709322:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787388246.709332:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b52f5ce00/0x26817551a4475a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475a5a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.709375:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b52f5ce00/0x26817551a4475a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475a5a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787388246.710011:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787388246.710015:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff996a44056800 from 10 10000000:01000000:1.0:1787388246.710019:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787388246.710053:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077400/0x26817551a4475a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.710062:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b70077400/0x26817551a4475a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.710072:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b70077400/0x26817551a4475a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388246.710090:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945781120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787388246.710490:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388246.710527:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4a9a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1787388246.710612:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945781120 00000100:00100000:2.0:1787388246.710619:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945781120 00000100:00100000:2.0:1787388246.710732:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787388246.710741:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:17091:x1874211945781120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388246.710754:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388246.710766:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f5c000/0x26817551a4475a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475a61 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.710789:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f5c000/0x26817551a4475a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475a61 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.710799:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f5c000/0x26817551a4475a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475a61 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388246.710808:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c000, rc 0) 00000100:00100000:2.0:1787388246.710845:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:17091:x1874211945781120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.710852:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787388246.710929:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945781120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388246.711218:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b70077400/0x26817551a4475a61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475a68 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.711228:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b70077400/0x26817551a4475a61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475a68 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388246.711277:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945781248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787388246.711313:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388246.711342:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4a9a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1787388246.712113:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945781248 00000100:00100000:2.0:1787388246.712121:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945781248 00000100:00100000:2.0:1787388246.712551:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787388246.712560:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:17091:x1874211945781248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787388246.712582:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787388246.712776:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787388246.712779:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1787388246.712885:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:17091:x1874211945781248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 325us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388246.712893:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787388246.713235:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945781248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787388246.713310:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787388246.713319:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b70077400/0x26817551a4475a61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475a68 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388246.713329:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b70077400/0x26817551a4475a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475a68 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388246.767314:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945781376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388246.767417:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388246.767473:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388246.767483:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945781504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388246.767508:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388246.767537:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945781376 00000100:00100000:0.0:1787388246.767544:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945781376 00000100:00100000:0.0:1787388246.767576:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945781504 00000100:00100000:0.0:1787388246.767580:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945781504 00000100:00100000:0.0:1787388246.767611:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787388246.767620:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945781376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388246.768030:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787388246.768087:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945781376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 468us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388246.768101:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787388246.768119:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787388246.768125:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945781504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388246.768142:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787388246.768175:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945781504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388246.768263:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787388246.768310:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945781504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388246.768490:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945781376:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787388247.025894:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388248.046446:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787388248.749043:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787388249.071455:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388250.092876:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388250.863528:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945781632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388250.863599:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388250.863725:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945781632 00000100:00100000:3.0:1787388250.863733:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945781632 00000100:00100000:3.0:1787388250.863792:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787388250.863801:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945781632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388250.863835:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1787388250.867395:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388250.869718:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945781632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5908us (6110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388250.869731:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787388250.880309:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945781632:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787388251.116501:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388251.885044:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945781760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388251.885150:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.885218:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945781760 00000100:00100000:2.0:1787388251.885225:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945781760 00000100:00100000:2.0:1787388251.892383:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787388251.892403:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945781760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388251.892447:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787388251.892570:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945782144:0@lo:400:kworker.0 00000100:00100000:1.0:1787388251.892935:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945782016:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.896025:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945781760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3619us (10863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.896040:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787388251.896829:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388251.896877:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945782656:0@lo:400:kworker.0 00000100:00100000:3.0:1787388251.896917:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388251.896949:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945783168:0@lo:400:kworker.0 00000100:00100000:3.0:1787388251.897001:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.897418:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945781888:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.897453:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.897481:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945782400:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.897525:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.897542:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945782912:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.897560:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.897575:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945783424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388251.897599:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.897629:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787388251.897636:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945782272:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.897656:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.897673:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945782784:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.897691:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388251.898235:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945782144 00000100:00100000:3.0:1787388251.898244:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945782144 00000100:00100000:3.0:1787388251.898302:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945782656 00000100:00100000:3.0:1787388251.898305:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945782656 00000100:00100000:3.0:1787388251.898334:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787388251.898344:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874211945782144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388251.898418:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874211945782144:12345-0@lo:400:kworker.0 Request processed in 76us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388251.898426:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787388251.898443:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787388251.898449:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945782656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388251.898481:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945782656:12345-0@lo:400:kworker.0 Request processed in 32us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388251.898488:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787388251.898518:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945783680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388251.898559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388251.898602:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945782144:0@lo:400:kworker.0 00000100:00100000:3.0:1787388251.898619:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945782656:0@lo:400:kworker.0 00000100:00100000:3.0:1787388251.898642:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787388251.898649:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945783552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388251.898673:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.898799:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945783296:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.898828:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.898868:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945781760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388251.898928:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945783168 00000100:00100000:2.0:1787388251.898932:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945783168 00000100:00100000:2.0:1787388251.898955:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945782912 00000100:00100000:2.0:1787388251.898958:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945782912 00000100:00100000:2.0:1787388251.898973:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945782272 00000100:00100000:2.0:1787388251.898975:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945782272 00000100:00100000:2.0:1787388251.898986:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945782784 00000100:00100000:2.0:1787388251.898989:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945782784 00000100:00100000:1.0:1787388251.899002:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.899004:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945783296 00000100:00100000:2.0:1787388251.899008:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945783296 00000100:00100000:2.0:1787388251.899029:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787388251.899035:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945782528:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.899037:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945783168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388251.899222:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388251.899649:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945783168:12345-0@lo:400:kworker.0 Request processed in 612us (2646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.899656:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787388251.899673:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787388251.899680:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945782912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.899800:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945782912:12345-0@lo:400:kworker.0 Request processed in 122us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.899815:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787388251.899827:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787388251.899832:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945782272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.899860:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945782272:12345-0@lo:400:kworker.0 Request processed in 28us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.899865:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787388251.899876:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787388251.899882:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945782784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.899906:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945782784:12345-0@lo:400:kworker.0 Request processed in 25us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.899912:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787388251.899933:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787388251.899939:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945783296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.899965:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945783296:12345-0@lo:400:kworker.0 Request processed in 26us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.899971:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787388251.899991:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945781888 00000100:00100000:2.0:1787388251.899995:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945781888 00000100:00100000:2.0:1787388251.900024:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787388251.900029:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3650:x1874211945781888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.900058:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3650:x1874211945781888:12345-0@lo:400:kworker.0 Request processed in 29us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.900064:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787388251.900103:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945782400 00000100:00100000:2.0:1787388251.900107:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945782400 00000100:00100000:2.0:1787388251.900130:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945783680 00000100:00100000:2.0:1787388251.900133:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945783680 00000100:00100000:2.0:1787388251.900145:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388251.900150:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874211945782400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.900183:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874211945782400:12345-0@lo:400:kworker.0 Request processed in 32us (2657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.900189:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787388251.900200:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787388251.900205:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945783680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388251.900226:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388251.900300:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945783680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.900306:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787388251.900328:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945783424 00000100:00100000:2.0:1787388251.900332:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945783424 00000100:00100000:2.0:1787388251.900370:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945783552 00000100:00100000:2.0:1787388251.900373:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945783552 00000100:00100000:2.0:1787388251.900387:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787388251.900392:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945783424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787388251.900406:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787388251.900435:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945783424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.900441:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787388251.900452:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787388251.900458:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874211945783552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787388251.900472:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787388251.900497:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874211945783552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.900510:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787388251.904533:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945783040:0@lo:400:kworker.0 00000100:00100000:1.0:1787388251.904595:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388251.904993:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388251.905000:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388251.905010:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388251.905013:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388251.907257:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945782016 00000100:00100000:2.0:1787388251.907270:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945782016 00000100:00100000:2.0:1787388251.907326:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945782528 00000100:00100000:2.0:1787388251.907331:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945782528 00000100:00100000:2.0:1787388251.907370:0:19466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787388251.907381:0:19466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945782016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.907706:0:19466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945782016:12345-0@lo:400:kworker.0 Request processed in 317us (8696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.907715:0:19466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787388251.907733:0:19466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787388251.907741:0:19466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945782528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.907772:0:19466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945782528:12345-0@lo:400:kworker.0 Request processed in 32us (8551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.907778:0:19466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787388251.907811:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945783808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388251.907849:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787388251.907906:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7c0c8e00 x1874211945782272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388251.907930:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945782272:0@lo:400:kworker.0 00010000:00080000:2.0:1787388251.907945:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b412ac000 x1874211945782784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388251.907954:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945782784:0@lo:400:kworker.0 00010000:00080000:2.0:1787388251.907966:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b412aed80 x1874211945783296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388251.907982:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945783296:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.907995:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945781888:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.908008:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945782400:0@lo:400:kworker.0 00010000:00080000:2.0:1787388251.908019:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b412ad880 x1874211945782912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388251.908027:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945782912:0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.908044:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945783424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388251.908273:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945783040 00000100:00100000:2.0:1787388251.908278:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945783040 00000100:00100000:2.0:1787388251.908318:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787388251.908326:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945783040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388251.908385:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874211945783040:12345-0@lo:400:kworker.0 Request processed in 60us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.908392:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787388251.908501:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945783808 00000100:00100000:2.0:1787388251.908505:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945783808 00000100:00100000:2.0:1787388251.908531:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787388251.908537:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945783808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388251.908550:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787388251.908583:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945783808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388251.908589:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787388251.908604:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787388251.908639:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945783808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388251.908762:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945783552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787388251.908777:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945783680:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787388251.908789:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b412aca80 x1874211945783168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388251.908797:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945783168:0@lo:400:kworker.0 00000100:00100000:1.0:1787388251.908970:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945782016:0@lo:400:kworker.0 00000100:00100000:1.0:1787388251.908986:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945782528:0@lo:400:kworker.0 00010000:00080000:1.0:1787388251.909002:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b412af100 x1874211945783040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388251.909013:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1874211945783040:0@lo:400:kworker.0 00010000:00010000:2.0:1787388252.140594:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787388252.406381:0:19414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:02000400:0.0:1787388252.559732:0:19771:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787388253.164627:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787388253.537797:0:19823:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787388253.538049:0:19823:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1787388253.805008:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787388254.189812:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787388254.476117:0:19874:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787388254.476442:0:19874:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787388254.824102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388254.830693:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925773952 00000100:00100000:2.0:1787388254.830709:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925773952 00000100:00100000:3.0:1787388254.833381:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 114 00000100:00100000:3.0:1787388254.833403:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1874211925773952:12345-192.168.203.15@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787388254.833432:0:17089:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 8bcdc57b-3459-40d2-a2c1-acec130207c7@192.168.203.15@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:3.0:1787388254.833457:0:17089:0:(genops.c:1406:class_connect()) connect: client 8bcdc57b-3459-40d2-a2c1-acec130207c7, cookie 0x26817551a4475a6f 00000100:00080000:3.0:1787388254.833595:0:17089:0:(import.c:65:import_set_state_nolock()) ffff996b46159000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388254.833670:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+5:2398:x1874211925773952:12345-192.168.203.15@tcp:250:mount.lustre.0 Request processed in 268us (9576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388254.833679:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 114 00000100:00100000:2.0:1787388254.839337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388254.839580:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925774080 00000100:00100000:1.0:1787388254.839590:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925774080 00000100:00100000:1.0:1787388254.839647:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:1.0:1787388254.839658:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7296ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+5:14917:x1874211925774080:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787388254.839674:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388254.839691:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70076e00/0x26817551a4475a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8183 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388254.839720:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70076e00/0x26817551a4475a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8183 expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388254.839731:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70076e00/0x26817551a4475a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8183 expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388254.839740:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076e00, rc 0) 00000100:00100000:1.0:1787388254.839800:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7296ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+6:14917:x1874211925774080:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 143us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388254.839824:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:1.0:1787388254.848617:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388254.852578:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925774208 00000100:00100000:3.0:1787388254.852594:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925774208 00000100:00100000:1.0:1787388254.853200:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:1.0:1787388254.853215:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+6:14917:x1874211925774208:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787388254.853372:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+6:14917:x1874211925774208:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 161us (4763us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787388254.853381:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:3.0:1787388254.860453:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388254.860852:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925774336 00000100:00100000:2.0:1787388254.860862:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925774336 00000100:00100000:2.0:1787388254.860991:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:2.0:1787388254.861002:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+6:14917:x1874211925774336:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787388254.861021:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388254.861043:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b52f5c400/0x26817551a4475a7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe818a expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388254.861393:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b52f5c400/0x26817551a4475a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe818a expref: 7 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388254.861410:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b52f5c400/0x26817551a4475a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe818a expref: 7 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388254.861436:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b52f5c400, rc 0) 00000100:00100000:2.0:1787388254.861499:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+7:14917:x1874211925774336:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 499us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388254.861506:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:2.0:1787388254.865297:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388254.865841:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925774464 00000100:00100000:0.0:1787388254.865856:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925774464 00000100:00100000:0.0:1787388254.865928:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:0.0:1787388254.865939:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+7:14917:x1874211925774464:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787388254.866108:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+8:14917:x1874211925774464:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 170us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388254.866116:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:1.0:1787388254.874270:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388254.875032:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925774592 00000100:00100000:2.0:1787388254.875043:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925774592 00000100:00100000:2.0:1787388254.875102:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 119 00000100:00100000:2.0:1787388254.875112:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+8:14917:x1874211925774592:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787388254.875262:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+8:14917:x1874211925774592:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 150us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388254.875271:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 119 00000100:00100000:3.0:1787388254.884926:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388254.885292:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925774720 00000100:00100000:1.0:1787388254.885302:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925774720 00000100:00100000:1.0:1787388254.885379:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:1.0:1787388254.885389:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+8:14936:x1874211925774720:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787388254.885552:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+8:14936:x1874211925774720:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 162us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388254.885560:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:3.0:1787388254.903961:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388254.904119:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925774848 00000100:00100000:0.0:1787388254.904129:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925774848 00000100:00100000:0.0:1787388254.904205:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:0.0:1787388254.904214:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+8:14936:x1874211925774848:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388254.904393:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+8:14936:x1874211925774848:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 179us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388254.904402:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:0.0:1787388254.921573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388254.921827:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925774976 00000100:00100000:2.0:1787388254.921837:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925774976 00000100:00100000:1.0:1787388254.922013:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 122 00000100:00100000:1.0:1787388254.922024:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+8:14936:x1874211925774976:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787388254.922198:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+8:14936:x1874211925774976:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 175us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388254.922206:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 122 00000100:00100000:2.0:1787388254.929803:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388254.930135:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925775104 00000100:00100000:1.0:1787388254.930145:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925775104 00000100:00100000:1.0:1787388254.930241:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 123 00000100:00100000:1.0:1787388254.930252:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+8:14917:x1874211925775104:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787388254.930291:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388254.930310:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70076200/0x26817551a4475a84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe81bb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388254.930337:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70076200/0x26817551a4475a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81bb expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388254.930369:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70076200/0x26817551a4475a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81bb expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388254.930378:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076200, rc 0) 00000100:00100000:1.0:1787388254.930443:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+9:14917:x1874211925775104:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 192us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388254.930450:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 123 00000100:00100000:3.0:1787388254.938484:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388254.938581:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925775232 00000100:00100000:1.0:1787388254.938592:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925775232 00000100:00100000:1.0:1787388254.938680:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:1.0:1787388254.938699:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+9:14917:x1874211925775232:12345-192.168.203.15@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787388254.938722:0:17087:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787388254.938744:0:17087:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787388254.938747:0:17087:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787388254.938750:0:17087:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787388254.938753:0:17087:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787388254.938755:0:17087:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1787388254.942667:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+9:14917:x1874211925775232:12345-192.168.203.15@tcp:256:mount.lustre.0 Request processed in 3969us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388254.942691:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:2.0:1787388254.948308:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388254.948589:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925775360 00000100:00100000:3.0:1787388254.948601:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925775360 00000100:00100000:3.0:1787388254.948674:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:3.0:1787388254.948691:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+9:14917:x1874211925775360:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787388254.948717:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388254.948734:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f6600/0x26817551a4475a8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe81c2 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388254.948761:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f6600/0x26817551a4475a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81c2 expref: 10 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388254.948772:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f6600/0x26817551a4475a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81c2 expref: 10 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388254.948781:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6600, rc 0) 00000100:00100000:3.0:1787388254.948837:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+10:14917:x1874211925775360:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 148us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388254.948845:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:3.0:1787388254.951152:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388254.951281:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925775488 00000100:00100000:1.0:1787388254.951302:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925775488 00000100:00100000:1.0:1787388254.951374:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:1.0:1787388254.951384:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+10:14917:x1874211925775488:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787388254.951542:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+10:14917:x1874211925775488:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 159us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388254.951550:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:2.0:1787388254.953752:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388254.953837:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925775616 00000100:00100000:0.0:1787388254.953845:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925775616 00000100:00100000:0.0:1787388254.953892:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:0.0:1787388254.953912:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b5dd71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+10:14917:x1874211925775616:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787388254.954048:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b5dd71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+10:14917:x1874211925775616:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 147us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388254.954056:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:2.0:1787388254.963998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388254.965378:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925775744 00000100:00100000:3.0:1787388254.965399:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925775744 00000100:00100000:3.0:1787388254.965452:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 128 00000100:00100000:3.0:1787388254.965461:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+10:14941:x1874211925775744:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388254.965757:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+10:14941:x1874211925775744:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 295us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388254.965765:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 128 00000100:00100000:2.0:1787388254.979568:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388254.979680:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925775872 00000100:00100000:1.0:1787388254.979690:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925775872 00000100:00100000:3.0:1787388254.979775:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 129 00000100:00100000:3.0:1787388254.979787:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+10:14941:x1874211925775872:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388254.979953:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+10:14941:x1874211925775872:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 168us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388254.979970:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 129 00000100:00100000:2.0:1787388254.988125:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388254.988233:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388254.995687:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925776000 00000100:00100000:0.0:1787388254.995705:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925776000 00000100:00100000:0.0:1787388254.995755:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925776256 00000100:00100000:0.0:1787388254.995759:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925776256 00000100:00100000:0.0:1787388254.995777:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1787388254.995786:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1874211925776000:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787388254.995817:0:17096:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94@192.168.203.15@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1787388254.995864:0:17096:0:(genops.c:1406:class_connect()) connect: client 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94, cookie 0x26817551a4475a92 00000004:00100000:0.0:1787388254.995889:0:17096:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787388254.996100:0:17096:0:(import.c:65:import_set_state_nolock()) ffff996a42cc7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388254.996401:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2398:x1874211925776000:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 613us (8282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388254.996409:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1787388254.996442:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:0.0:1787388254.996447:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1874211925776256:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787388254.996464:0:17096:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94@192.168.203.15@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1787388254.996496:0:17096:0:(genops.c:1406:class_connect()) connect: client 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94, cookie 0x26817551a4475a99 00000004:00100000:0.0:1787388254.996510:0:17096:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787388254.996623:0:17096:0:(import.c:65:import_set_state_nolock()) ffff996a42cc4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388254.996649:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2398:x1874211925776256:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 201us (8417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388254.996655:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:0.0:1787388255.011514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388255.011913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388255.012045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388255.012736:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925776512 00000100:00100000:2.0:1787388255.012746:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925776512 00000100:00100000:2.0:1787388255.012814:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925776384 00000100:00100000:2.0:1787388255.012817:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925776384 00000100:00100000:2.0:1787388255.012835:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:2.0:1787388255.012857:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:14917:x1874211925776512:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787388255.012893:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388255.012997:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:14917:x1874211925776512:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 141us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388255.013006:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:2.0:1787388255.013024:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:2.0:1787388255.013032:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:0:x1874211925776384:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787388255.013050:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388255.013093:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:0:x1874211925776384:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 63us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388255.013100:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00080000:3.0:1787388255.013954:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388255.013960:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388255.014600:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925776128 00000100:00100000:2.0:1787388255.014611:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925776128 00000100:00100000:2.0:1787388255.014664:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:2.0:1787388255.014673:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:0:x1874211925776128:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787388255.014818:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388255.014881:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:0:x1874211925776128:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 208us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388255.014888:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:2.0:1787388255.019704:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388255.021504:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925776640 00000100:00100000:3.0:1787388255.021517:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925776640 00000100:00100000:3.0:1787388255.021594:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:3.0:1787388255.021604:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:14917:x1874211925776640:12345-192.168.203.15@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787388255.021698:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:14917:x1874211925776640:12345-192.168.203.15@tcp:40:mount.lustre.0 Request processed in 95us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388255.021705:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:3.0:1787388255.027131:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388255.027165:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388255.027300:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925777024 00000100:00100000:1.0:1787388255.027309:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925777024 00000100:00100000:1.0:1787388255.027381:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:1.0:1787388255.027400:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:14917:x1874211925777024:12345-192.168.203.15@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787388255.027481:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:14917:x1874211925777024:12345-192.168.203.15@tcp:900:mount.lustre.0 Request processed in 92us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388255.027489:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:3.0:1787388255.028034:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388255.030391:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925776768 00000100:00100000:2.0:1787388255.030406:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925776768 00000100:00100000:2.0:1787388255.030490:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925776896 00000100:00100000:2.0:1787388255.030494:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925776896 00000100:00100000:3.0:1787388255.030525:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1787388255.030533:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1874211925776768:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787388255.030579:0:18600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94@192.168.203.15@tcp t0 exp 0000000000000000 cur 576 last 0 00000100:00100000:0.0:1787388255.030606:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1787388255.030613:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874211925776896:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787388255.030630:0:18601:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94@192.168.203.15@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:3.0:1787388255.030877:0:18600:0:(genops.c:1406:class_connect()) connect: client 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94, cookie 0x26817551a4475aa7 00002000:00100000:3.0:1787388255.030890:0:18600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94/ffff996b4615b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787388255.030918:0:18600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787388255.031071:0:18600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787388255.031099:0:18600:0:(import.c:65:import_set_state_nolock()) ffff996b46159800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787388255.031420:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2398:x1874211925776768:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 885us (4252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388255.031428:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000020:00000080:0.0:1787388255.034564:0:18601:0:(genops.c:1406:class_connect()) connect: client 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94, cookie 0x26817551a4475aa0 00002000:00100000:0.0:1787388255.034584:0:18601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94/ffff996a42cc1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787388255.034604:0:18601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787388255.034952:0:18601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787388255.034996:0:18601:0:(import.c:65:import_set_state_nolock()) ffff996a42cc3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388255.035074:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2398:x1874211925776896:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 4459us (7041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388255.035083:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:3.0:1787388255.042432:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388255.042723:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925777152 00000100:00100000:2.0:1787388255.042733:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925777152 00000100:00100000:2.0:1787388255.042806:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:2.0:1787388255.042815:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:14917:x1874211925777152:12345-192.168.203.15@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787388255.044850:0:17097:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1955us 00000004:00200000:2.0:1787388255.088849:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787388255.088973:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:14917:x1874211925777152:12345-192.168.203.15@tcp:33:mount.lustre.0 Request processed in 46154us (46544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388255.088984:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00010000:00010000:2.0:1787388255.212804:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388255.247208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388255.247641:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925777280 00000100:00100000:1.0:1787388255.247657:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925777280 00000100:00100000:1.0:1787388255.247730:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:1.0:1787388255.247742:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:14964:x1874211925777280:12345-192.168.203.15@tcp:101:mkdir.0 00010000:00010000:1.0:1787388255.247782:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388255.247820:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077a00/0x26817551a4475aae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe81f3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388255.247925:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ab5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388255.247965:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388255.247986:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388255.248058:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388255.248062:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388255.248464:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388255.248513:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077a00/0x26817551a4475aae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81f3 expref: 8 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388255.248537:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81f3 expref: 7 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388255.248546:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48700) 00010000:00010000:1.0:1787388255.248549:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388255.248553:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076400, rc 0) 00000100:00100000:1.0:1787388255.248668:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:14964:x1874211925777280:12345-192.168.203.15@tcp:101:mkdir.0 Request processed in 927us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388255.248677:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:3.0:1787388255.981763:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787388255.981796:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945783936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388255.981903:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388255.982154:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945783936 00000100:00100000:0.0:1787388255.982187:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945783936 00000100:00100000:0.0:1787388255.982271:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787388255.982283:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945783936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787388255.982316:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1787388255.982517:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388255.984270:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945783936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1978us (2365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388255.984287:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787388255.985505:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945783936:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787388256.238546:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388257.004742:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945784320:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.004841:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388257.004967:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945784320 00000100:00100000:0.0:1787388257.004976:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945784320 00000100:00100000:0.0:1787388257.005052:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787388257.005064:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945784320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005128:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945784320:12345-0@lo:400:kworker.0 Request processed in 66us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.005137:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787388257.005185:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945784320:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005223:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388257.005228:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945784448:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005251:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388257.005301:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945784832:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005336:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388257.005414:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388257.005420:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945784960:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005444:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388257.005466:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945784448 00000100:00100000:0.0:1787388257.005487:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945784448 00000100:00100000:0.0:1787388257.005512:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945784832 00000100:00100000:0.0:1787388257.005514:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945784832 00000100:00100000:0.0:1787388257.005527:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945784960 00000100:00100000:0.0:1787388257.005529:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945784960 00000100:00100000:0.0:1787388257.005541:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787388257.005547:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945784448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005581:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945784448:12345-0@lo:400:kworker.0 Request processed in 35us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.005588:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787388257.005598:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787388257.005603:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945784832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005625:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945784832:12345-0@lo:400:kworker.0 Request processed in 22us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.005631:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787388257.005640:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787388257.005646:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945784960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005671:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945784960:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.005677:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787388257.005702:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945784960:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005712:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945784832:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005720:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787388257.005733:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945784448:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005771:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945785344:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005807:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388257.005847:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388257.005853:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945785472:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.005878:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388257.006102:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945784192:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006141:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388257.006180:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945784704:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006203:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388257.006216:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945785216:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006234:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388257.006253:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787388257.006259:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945784064:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006287:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388257.006306:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945784576:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388257.006380:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945785088:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006402:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388257.006413:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945785600:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388257.006469:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945785344 00000100:00100000:3.0:1787388257.006475:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945785344 00000100:00100000:3.0:1787388257.006509:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945785472 00000100:00100000:3.0:1787388257.006513:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945785472 00000100:00100000:3.0:1787388257.006527:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945785216 00000100:00100000:3.0:1787388257.006529:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945785216 00000100:00100000:3.0:1787388257.006542:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945784576 00000100:00100000:3.0:1787388257.006555:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945784576 00000100:00100000:3.0:1787388257.006571:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945785088 00000100:00100000:3.0:1787388257.006573:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945785088 00000100:00100000:3.0:1787388257.006583:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945785600 00000100:00100000:3.0:1787388257.006585:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945785600 00000100:00100000:3.0:1787388257.006598:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787388257.006605:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945785344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006648:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874211945785344:12345-0@lo:400:kworker.0 Request processed in 44us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.006655:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787388257.006667:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787388257.006672:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945785472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006712:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874211945785472:12345-0@lo:400:kworker.0 Request processed in 40us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.006718:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787388257.006729:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787388257.006734:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945785216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006761:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945785216:12345-0@lo:400:kworker.0 Request processed in 28us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.006766:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787388257.006775:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787388257.006780:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945784576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006800:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945784576:12345-0@lo:400:kworker.0 Request processed in 20us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.006806:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787388257.006815:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787388257.006820:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945785088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006850:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945785088:12345-0@lo:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.006855:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787388257.006865:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787388257.006870:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945785600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006903:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945785600:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.006908:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787388257.006926:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388257.006930:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787388257.006933:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787388257.006935:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388257.006960:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945784576:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006970:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945785088:0@lo:400:kworker.0 00010000:00080000:3.0:1787388257.006981:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4223ea00 x1874211945785600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388257.006990:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945785600:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.006999:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945785216:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.007031:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1874211945785472:0@lo:400:kworker.0 00010000:00080000:3.0:1787388257.007041:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a43935f80 x1874211945785344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787388257.007049:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1874211945785344:0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.007526:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945784192 00000100:00100000:0.0:1787388257.007534:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945784192 00000100:00100000:0.0:1787388257.007566:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945784704 00000100:00100000:0.0:1787388257.007569:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945784704 00000100:00100000:0.0:1787388257.007584:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787388257.007591:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945784192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.007658:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945784192:12345-0@lo:400:kworker.0 Request processed in 67us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.007666:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787388257.007678:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787388257.007684:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945784704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.007730:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945784704:12345-0@lo:400:kworker.0 Request processed in 46us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.007736:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787388257.007756:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945784064 00000100:00100000:0.0:1787388257.007759:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945784064 00000100:00100000:0.0:1787388257.007794:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787388257.007801:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3652:x1874211945784064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388257.007831:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3652:x1874211945784064:12345-0@lo:400:kworker.0 Request processed in 31us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.007837:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787388257.007956:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945784064:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.007977:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945784192:0@lo:400:kworker.0 00000100:00100000:3.0:1787388257.007987:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945784704:0@lo:400:kworker.0 00000100:00100000:2.0:1787388257.008559:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787388257.008572:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945785856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388257.008617:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388257.008656:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945785856 00000100:00100000:2.0:1787388257.008660:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945785856 00000100:00100000:2.0:1787388257.008687:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787388257.008693:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945785856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388257.008735:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388257.008769:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945785856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388257.008776:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787388257.008817:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945785856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388257.008835:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945785728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388257.008858:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388257.008904:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945785728 00000100:00100000:2.0:1787388257.008908:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945785728 00000100:00100000:2.0:1787388257.008934:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787388257.008949:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945785728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388257.008970:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787388257.009000:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945785728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388257.009005:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787388257.009032:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945785728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388257.010184:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945786112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388257.010245:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388257.010296:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945786112 00000100:00100000:1.0:1787388257.010315:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945786112 00000100:00100000:1.0:1787388257.010399:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388257.010408:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945786112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388257.010435:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787388257.010478:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945786112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388257.010485:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388257.010528:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f58f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945786112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787388257.010738:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945786240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388257.010774:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388257.010973:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945786240 00000100:00100000:0.0:1787388257.010978:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945786240 00000100:00100000:0.0:1787388257.011024:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787388257.011032:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945786240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787388257.011046:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787388257.011085:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945786240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.011092:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787388257.011216:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945785984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787388257.011255:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388257.011407:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945785984 00000100:00100000:0.0:1787388257.011412:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945785984 00000100:00100000:0.0:1787388257.011485:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787388257.011494:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945785984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388257.011523:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787388257.011573:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945785984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.011580:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787388257.011642:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945785984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388257.013541:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945786240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787388257.260662:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388257.387162:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388257.388742:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925777408 00000100:00100000:3.0:1787388257.388760:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925777408 00000100:00100000:1.0:1787388257.388999:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:1.0:1787388257.389016:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:15017:x1874211925777408:12345-192.168.203.15@tcp:41:lfs.0 00000004:00000024:1.0:1787388257.389071:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787388257.389207:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:15017:x1874211925777408:12345-192.168.203.15@tcp:41:lfs.0 Request processed in 195us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388257.389216:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:3.0:1787388257.393860:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388257.393991:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925777536 00000100:00100000:2.0:1787388257.394005:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925777536 00000100:00080000:0.0:1787388257.394112:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787388257.394118:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388257.394778:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:2.0:1787388257.394791:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:15017:x1874211925777536:12345-192.168.203.15@tcp:41:lfs.0 00000004:00000024:2.0:1787388257.394832:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388257.395047:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:15017:x1874211925777536:12345-192.168.203.15@tcp:41:lfs.0 Request processed in 258us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388257.395056:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:2.0:1787388257.415037:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388257.415231:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925777664 00000100:00100000:0.0:1787388257.415244:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925777664 00000100:00100000:0.0:1787388257.415411:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:0.0:1787388257.415423:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:15017:x1874211925777664:12345-192.168.203.15@tcp:13:lfs.0 00002000:00000024:0.0:1787388257.415459:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787388257.415565:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:15017:x1874211925777664:12345-192.168.203.15@tcp:13:lfs.0 Request processed in 145us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.415575:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00080000:3.0:1787388257.418261:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388257.431315:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388257.431698:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925777792 00000100:00100000:0.0:1787388257.431711:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925777792 00000100:00100000:0.0:1787388257.431808:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1787388257.431843:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:15017:x1874211925777792:12345-192.168.203.15@tcp:13:lfs.0 00002000:00000024:0.0:1787388257.431878:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787388257.431992:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:15017:x1874211925777792:12345-192.168.203.15@tcp:13:lfs.0 Request processed in 156us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.432000:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00080000:3.0:1787388257.434376:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388257.720779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388257.721067:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925777920 00000100:00100000:1.0:1787388257.721081:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925777920 00000100:00100000:1.0:1787388257.721201:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:1.0:1787388257.721213:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+10:15049:x1874211925777920:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787388257.721236:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388257.721260:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70077a00/0x26817551a4475abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe81fa expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388257.721311:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077a00/0x26817551a4475abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81fa expref: 11 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388257.721389:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70077a00/0x26817551a4475abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81fa expref: 11 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388257.721412:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077a00, rc 0) 00000100:00100000:1.0:1787388257.721493:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15049:x1874211925777920:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 283us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388257.721510:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:2.0:1787388257.734808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388257.734925:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925778048 00000100:00100000:1.0:1787388257.734935:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925778048 00000100:00100000:1.0:1787388257.735001:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:1.0:1787388257.735011:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15049:x1874211925778048:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787388257.735303:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15049:x1874211925778048:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 292us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388257.735312:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:3.0:1787388257.752206:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388257.755237:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925778176 00000100:00100000:1.0:1787388257.755264:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925778176 00000100:00100000:1.0:1787388257.755382:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:1.0:1787388257.755394:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15049:x1874211925778176:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787388257.755546:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15049:x1874211925778176:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 153us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388257.755554:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:2.0:1787388257.767626:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388257.767854:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925778304 00000100:00100000:0.0:1787388257.767864:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925778304 00000100:00100000:0.0:1787388257.767937:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:0.0:1787388257.767946:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15056:x1874211925778304:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388257.768322:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15056:x1874211925778304:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 376us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.768330:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:2.0:1787388257.830972:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388257.831607:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925778432 00000100:00100000:3.0:1787388257.831667:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925778432 00000100:00100000:3.0:1787388257.831789:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 135 00000100:00100000:3.0:1787388257.831800:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15056:x1874211925778432:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787388257.831981:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15056:x1874211925778432:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 182us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.831989:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 135 00000100:00100000:3.0:1787388257.840333:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388257.840498:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925778560 00000100:00100000:1.0:1787388257.840514:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925778560 00000100:00100000:1.0:1787388257.840581:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:1.0:1787388257.840591:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15056:x1874211925778560:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787388257.840770:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15056:x1874211925778560:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 180us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388257.840778:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:2.0:1787388257.855025:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388257.856337:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925778688 00000100:00100000:3.0:1787388257.856397:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925778688 00000100:00100000:3.0:1787388257.856491:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:3.0:1787388257.856504:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7295cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:15049:x1874211925778688:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787388257.856526:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388257.856567:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f7e00/0x26817551a4475ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe822b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388257.856603:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f7e00/0x26817551a4475ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe822b expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388257.856617:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f7e00/0x26817551a4475ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe822b expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388257.856629:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7e00, rc 0) 00000100:00100000:3.0:1787388257.857410:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7295cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+12:15049:x1874211925778688:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 903us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.857420:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:2.0:1787388257.877451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388257.877580:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925778816 00000100:00100000:1.0:1787388257.877593:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925778816 00000100:00100000:1.0:1787388257.877668:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 138 00000100:00100000:1.0:1787388257.877680:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b58389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+12:15049:x1874211925778816:12345-192.168.203.15@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787388257.877716:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787388257.877749:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787388257.877754:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787388257.877757:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787388257.877761:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787388257.877764:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1787388257.883504:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b58389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+12:15049:x1874211925778816:12345-192.168.203.15@tcp:256:mount.lustre.0 Request processed in 5808us (6051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388257.883525:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 138 00000100:00100000:2.0:1787388257.890529:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388257.890855:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925778944 00000100:00100000:1.0:1787388257.890869:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925778944 00000100:00100000:1.0:1787388257.891005:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 139 00000100:00100000:1.0:1787388257.891017:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+12:15049:x1874211925778944:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787388257.891039:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388257.891073:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70076800/0x26817551a4475aca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8232 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388257.891110:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70076800/0x26817551a4475aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8232 expref: 13 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388257.891146:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70076800/0x26817551a4475aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8232 expref: 13 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388257.891158:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076800, rc 0) 00000100:00100000:1.0:1787388257.891234:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:15049:x1874211925778944:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 219us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388257.891252:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 139 00000100:00100000:2.0:1787388257.902474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388257.902591:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925779072 00000100:00100000:0.0:1787388257.902605:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925779072 00000100:00100000:0.0:1787388257.902685:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 140 00000100:00100000:0.0:1787388257.902704:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:15049:x1874211925779072:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787388257.902892:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:15049:x1874211925779072:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 197us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.902901:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 140 00000100:00100000:2.0:1787388257.906176:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388257.906284:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925779200 00000100:00100000:1.0:1787388257.906301:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925779200 00000100:00100000:1.0:1787388257.906415:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:1.0:1787388257.906427:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:15049:x1874211925779200:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787388257.906627:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:15049:x1874211925779200:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 202us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388257.906637:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:3.0:1787388257.921280:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388257.921747:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925779328 00000100:00100000:2.0:1787388257.921762:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925779328 00000100:00100000:2.0:1787388257.921839:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:2.0:1787388257.921851:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:15060:x1874211925779328:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787388257.922283:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:15060:x1874211925779328:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 431us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388257.922293:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:2.0:1787388257.932631:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388257.932796:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925779456 00000100:00100000:0.0:1787388257.932810:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925779456 00000100:00100000:0.0:1787388257.932892:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:0.0:1787388257.932903:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:15060:x1874211925779456:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787388257.933231:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:15060:x1874211925779456:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 328us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.933262:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:3.0:1787388257.937817:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388257.937891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388257.938013:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925780224 00000100:00100000:0.0:1787388257.938026:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925780224 00000100:00100000:0.0:1787388257.938116:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:0.0:1787388257.938128:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:2400:x1874211925780224:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388257.938229:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:2400:x1874211925780224:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 103us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.938238:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:0.0:1787388257.939668:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388257.939708:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388257.939770:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925780352 00000100:00100000:2.0:1787388257.939779:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925780352 00000100:00100000:2.0:1787388257.939828:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:2.0:1787388257.939837:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2400:x1874211925780352:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388257.939916:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2400:x1874211925780352:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388257.939925:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:1.0:1787388257.948862:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925780480 00000100:00100000:1.0:1787388257.948892:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925780480 00000100:00100000:0.0:1787388257.950756:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925780608 00000100:00100000:0.0:1787388257.950773:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925780608 00000100:00100000:0.0:1787388257.950809:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:0.0:1787388257.950821:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2400:x1874211925780480:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388257.950937:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2400:x1874211925780480:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 118us (13045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.950945:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:0.0:1787388257.950965:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:0.0:1787388257.950972:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2400:x1874211925780608:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388257.951002:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2400:x1874211925780608:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (11292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.951008:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:3.0:1787388257.951158:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388257.951666:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925779584 00000100:00100000:0.0:1787388257.951681:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925779584 00000100:00100000:0.0:1787388257.951758:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:0.0:1787388257.951766:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1874211925779584:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787388257.951796:0:17095:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8c15ba50-0abc-4066-8c74-637a6ad6a0f7@192.168.203.15@tcp t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:0.0:1787388257.951836:0:17095:0:(genops.c:1406:class_connect()) connect: client 8c15ba50-0abc-4066-8c74-637a6ad6a0f7, cookie 0x26817551a4475ad1 00000004:00100000:0.0:1787388257.951857:0:17095:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787388257.952132:0:17095:0:(import.c:65:import_set_state_nolock()) ffff996a42cc3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388257.952209:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2398:x1874211925779584:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 441us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.952217:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1787388257.963164:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388257.966592:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925779840 00000100:00100000:0.0:1787388257.966605:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925779840 00000100:00100000:0.0:1787388257.966758:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1787388257.966766:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874211925779840:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787388257.966796:0:17094:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 8c15ba50-0abc-4066-8c74-637a6ad6a0f7@192.168.203.15@tcp t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:0.0:1787388257.966834:0:17094:0:(genops.c:1406:class_connect()) connect: client 8c15ba50-0abc-4066-8c74-637a6ad6a0f7, cookie 0x26817551a4475ad8 00000004:00100000:0.0:1787388257.966856:0:17094:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787388257.966946:0:17094:0:(import.c:65:import_set_state_nolock()) ffff996a42cc6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787388257.967010:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2398:x1874211925779840:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 244us (3858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.967018:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:1.0:1787388257.978557:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388257.978589:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388257.978724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388257.984440:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925780096 00000100:00100000:3.0:1787388257.984454:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925780096 00000100:00100000:3.0:1787388257.984633:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925779968 00000100:00100000:3.0:1787388257.984638:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925779968 00000100:00100000:0.0:1787388257.984712:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925779712 00000100:00100000:0.0:1787388257.984716:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925779712 00000100:00100000:0.0:1787388257.984746:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:0.0:1787388257.984755:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+7:15049:x1874211925780096:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787388257.984794:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787388257.984894:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+7:15049:x1874211925780096:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 140us (6346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.984902:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:0.0:1787388257.984922:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:0.0:1787388257.984928:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:0:x1874211925779712:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787388257.984940:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787388257.984962:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:0:x1874211925779712:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 34us (6238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388257.984968:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00080000:1.0:1787388257.985214:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388257.985218:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787388257.985963:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1787388257.985973:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:0:x1874211925779968:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787388257.985996:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787388257.986037:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:0:x1874211925779968:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 64us (7446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.986044:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:1.0:1787388257.994098:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388257.994186:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925780736 00000100:00100000:3.0:1787388257.994195:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925780736 00000100:00100000:3.0:1787388257.994255:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1787388257.994266:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:15049:x1874211925780736:12345-192.168.203.15@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787388257.994641:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:15049:x1874211925780736:12345-192.168.203.15@tcp:40:mount.lustre.0 Request processed in 375us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388257.994650:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1787388258.001618:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388258.001754:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388258.001787:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388258.001857:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925780864 00000100:00100000:2.0:1787388258.001866:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925780864 00000100:00100000:2.0:1787388258.001917:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925780992 00000100:00100000:2.0:1787388258.001920:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925780992 00000100:00100000:2.0:1787388258.001936:0:19466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1787388258.001943:0:19466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1874211925780864:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787388258.001974:0:19466:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8c15ba50-0abc-4066-8c74-637a6ad6a0f7@192.168.203.15@tcp t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:2.0:1787388258.002001:0:19466:0:(genops.c:1406:class_connect()) connect: client 8c15ba50-0abc-4066-8c74-637a6ad6a0f7, cookie 0x26817551a4475adf 00002000:00100000:2.0:1787388258.002011:0:19466:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8c15ba50-0abc-4066-8c74-637a6ad6a0f7/ffff996b4834b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787388258.002033:0:19466:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787388258.002103:0:19466:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787388258.002132:0:19466:0:(import.c:65:import_set_state_nolock()) ffff996b4834f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388258.002193:0:19466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2398:x1874211925780864:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 249us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388258.002201:0:19466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1787388258.002218:0:19466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:2.0:1787388258.002222:0:19466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1874211925780992:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787388258.002238:0:19466:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8c15ba50-0abc-4066-8c74-637a6ad6a0f7@192.168.203.15@tcp t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:2.0:1787388258.002253:0:19466:0:(genops.c:1406:class_connect()) connect: client 8c15ba50-0abc-4066-8c74-637a6ad6a0f7, cookie 0x26817551a4475ae6 00002000:00100000:2.0:1787388258.002258:0:19466:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8c15ba50-0abc-4066-8c74-637a6ad6a0f7/ffff996b4834e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787388258.002263:0:19466:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787388258.002297:0:19466:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787388258.002311:0:19466:0:(import.c:65:import_set_state_nolock()) ffff996b4834d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787388258.002334:0:19466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2398:x1874211925780992:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 109us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388258.002340:0:19466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:1.0:1787388258.003057:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925781120 00000100:00100000:1.0:1787388258.003064:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925781120 00000100:00100000:1.0:1787388258.003112:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:1.0:1787388258.003120:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:15049:x1874211925781120:12345-192.168.203.15@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787388258.003175:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:15049:x1874211925781120:12345-192.168.203.15@tcp:900:mount.lustre.0 Request processed in 56us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388258.003182:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:0.0:1787388258.006763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388258.007006:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925781248 00000100:00100000:3.0:1787388258.007022:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925781248 00000100:00100000:3.0:1787388258.007144:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:3.0:1787388258.007156:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:15049:x1874211925781248:12345-192.168.203.15@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787388258.007246:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787388258.007962:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:15049:x1874211925781248:12345-192.168.203.15@tcp:33:mount.lustre.0 Request processed in 805us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388258.007971:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00010000:00010000:2.0:1787388258.285103:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388258.298729:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388258.298892:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925781376 00000100:00100000:0.0:1787388258.298901:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925781376 00000100:00100000:0.0:1787388258.298960:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:0.0:1787388258.298970:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:15083:x1874211925781376:12345-192.168.203.15@tcp:101:mkdir.0 00010000:00010000:0.0:1787388258.298990:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388258.299013:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09600/0x26817551a4475aed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8263 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388258.299077:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388258.299091:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388258.299103:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388258.299164:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787388258.299168:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388258.299189:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388258.299216:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09600/0x26817551a4475aed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8263 expref: 8 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388258.299235:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8263 expref: 7 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388258.299243:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48700) 00010000:00010000:0.0:1787388258.299246:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787388258.299249:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e08e00, rc 0) 00000100:00100000:0.0:1787388258.299312:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+7:15083:x1874211925781376:12345-192.168.203.15@tcp:101:mkdir.0 Request processed in 343us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388258.299320:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000040:00080000:3.0:1787388258.988952:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787388259.315680:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388260.333094:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787388260.599972:0:19414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c15ba50-0abc-4066-8c74-637a6ad6a0f7 00000001:00100000:3.0:1787388260.599986:0:19414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94 00000001:00100000:3.0:1787388260.600442:0:17075:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8c15ba50-0abc-4066-8c74-637a6ad6a0f7 00000001:00100000:3.0:1787388260.600448:0:17075:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94 00000001:00100000:2.0:1787388260.600987:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c15ba50-0abc-4066-8c74-637a6ad6a0f7 00000001:00100000:2.0:1787388260.601257:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94 00000001:00100000:1.0:1787388260.601417:0:17827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8c15ba50-0abc-4066-8c74-637a6ad6a0f7 00000001:00100000:1.0:1787388260.601423:0:17827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 59c9ee7e-2d2a-46d3-bbea-ecefe0429e94 00000100:00100000:0.0:1787388261.101138:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945786368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388261.101204:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388261.101342:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945786368 00000100:00100000:2.0:1787388261.101379:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945786368 00000100:00100000:2.0:1787388261.101437:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787388261.101447:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945786368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787388261.101487:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787388261.101531:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874211945786368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388261.101538:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787388261.101635:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1874211945786368:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787388261.101710:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787388261.378000:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787388261.689891:0:19972:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787388262.124734:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945786496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388262.124810:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388262.124925:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945786496 00000100:00100000:1.0:1787388262.124933:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945786496 00000100:00100000:1.0:1787388262.124986:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787388262.124996:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f58ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945786496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787388262.125023:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787388262.125067:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f58ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945786496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388262.125074:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787388262.125096:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945786624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388262.125121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787388262.125148:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787388262.125179:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945786496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388262.125200:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945786624 00000100:00100000:1.0:1787388262.125203:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945786624 00000100:00100000:1.0:1787388262.125225:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787388262.125388:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945786624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787388262.125402:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787388262.125435:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945786624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388262.125441:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787388262.125455:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388262.125474:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945786624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388262.125672:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388262.125681:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945786752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787388262.125769:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388262.125909:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945786880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388262.125938:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388262.125969:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945786880 00000100:00100000:3.0:1787388262.125973:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945786880 00000100:00100000:3.0:1787388262.125999:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787388262.126013:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945786880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388262.126024:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787388262.126068:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945786880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388262.126075:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787388262.126098:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388262.126118:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945786880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388262.126297:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388262.126306:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945787008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388262.126333:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388262.127731:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945787264:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.127786:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3651:1874211945787136:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.127834:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388262.127913:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945787648:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.127939:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388262.127955:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945788160:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.127977:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388262.128039:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945787520:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.128063:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388262.128081:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945788032:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.128123:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388262.128141:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787388262.128146:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945787392:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.128165:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388262.128183:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945787904:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.128201:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388262.129301:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945787648 00000100:00100000:1.0:1787388262.129312:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945787648 00000100:00100000:1.0:1787388262.129362:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945788160 00000100:00100000:1.0:1787388262.129365:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945788160 00000100:00100000:1.0:1787388262.129387:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945788032 00000100:00100000:1.0:1787388262.129390:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945788032 00000100:00100000:1.0:1787388262.129402:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945787392 00000100:00100000:1.0:1787388262.129404:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945787392 00000100:00100000:1.0:1787388262.129414:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945787904 00000100:00100000:1.0:1787388262.129417:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945787904 00000100:00100000:1.0:1787388262.129432:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787388262.129439:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945787648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.129503:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874211945787648:12345-0@lo:400:kworker.0 Request processed in 63us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388262.129511:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787388262.129544:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787388262.129551:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945788160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.129581:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874211945788160:12345-0@lo:400:kworker.0 Request processed in 31us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388262.129587:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787388262.129599:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787388262.129605:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945788032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.129635:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874211945788032:12345-0@lo:400:kworker.0 Request processed in 31us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388262.129642:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787388262.129654:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787388262.129672:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945787392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.129702:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945787392:12345-0@lo:400:kworker.0 Request processed in 32us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388262.129709:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787388262.129732:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787388262.129738:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945787904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.129768:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945787904:12345-0@lo:400:kworker.0 Request processed in 30us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388262.129774:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787388262.129810:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874211945787648:0@lo:400:kworker.0 00010000:00080000:1.0:1787388262.129823:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f5e9f80 x1874211945788160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388262.129833:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1874211945788160:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.129877:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945787392:0@lo:400:kworker.0 00010000:00080000:1.0:1787388262.129888:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7f5e8000 x1874211945787904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388262.129895:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945787904:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.129905:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1874211945788032:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.129945:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945787136 00000100:00100000:1.0:1787388262.129948:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945787136 00000100:00100000:1.0:1787388262.129975:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787388262.129981:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3651:x1874211945787136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.130017:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3651:x1874211945787136:12345-0@lo:400:kworker.0 Request processed in 36us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388262.130029:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787388262.130065:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3651:1874211945787136:0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.130092:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945787520 00000100:00100000:1.0:1787388262.130095:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945787520 00000100:00100000:1.0:1787388262.130125:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388262.130131:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945787520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388262.130165:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945787520:12345-0@lo:400:kworker.0 Request processed in 34us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388262.130172:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787388262.130195:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945787520:0@lo:400:kworker.0 00000100:00080000:3.0:1787388262.130475:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388262.130481:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388262.134257:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388262.138488:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945786752 00000100:00100000:2.0:1787388262.138614:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945786752 00000100:00100000:2.0:1787388262.138675:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945787008 00000100:00100000:2.0:1787388262.138679:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945787008 00000100:00100000:2.0:1787388262.138697:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787388262.138706:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945786752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388262.138930:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388262.139077:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945786752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 371us (13366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388262.139085:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787388262.139103:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787388262.139110:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945787008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388262.139127:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388262.139157:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945787008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (12823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388262.139163:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787388262.139433:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945787776:0@lo:400:kworker.0 00000100:00100000:0.0:1787388262.139469:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388262.139535:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945787776 00000100:00100000:0.0:1787388262.139540:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945787776 00000100:00100000:0.0:1787388262.139577:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787388262.139583:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945787776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388262.139617:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874211945787776:12345-0@lo:400:kworker.0 Request processed in 33us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388262.139623:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787388262.139657:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1874211945787776:0@lo:400:kworker.0 00000100:00100000:0.0:1787388262.139687:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945787008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787388262.139989:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945787264 00000100:00100000:1.0:1787388262.139994:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945787264 00000100:00100000:3.0:1787388262.140064:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945786752:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787388262.140084:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787388262.140121:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787388262.140130:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945787264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388262.140188:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945787264:12345-0@lo:400:kworker.0 Request processed in 61us (5947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388262.140195:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787388262.142638:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945787264:0@lo:400:kworker.0 00010000:00010000:2.0:1787388262.380699:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787388263.020997:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787388263.177379:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388263.177424:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388263.177526:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925781504 00000100:00100000:2.0:1787388263.177535:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925781504 00000100:00100000:2.0:1787388263.177580:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 145 00000100:00100000:2.0:1787388263.177590:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:2401:x1874211925781504:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388263.177667:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:2401:x1874211925781504:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 78us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388263.177676:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 145 00000100:00100000:0.0:1787388263.178392:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925781760 00000100:00100000:0.0:1787388263.178400:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925781760 00000100:00100000:0.0:1787388263.178451:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:0.0:1787388263.178461:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2401:x1874211925781760:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388263.178519:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2401:x1874211925781760:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 61us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388263.178527:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00080000:3.0:1787388263.178720:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388263.188540:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388263.188580:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388263.188611:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388263.188649:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388263.188671:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388263.188690:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388263.188723:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388263.188751:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925782016 00000100:00100000:1.0:1787388263.188760:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925782016 00000100:00100000:1.0:1787388263.188813:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925782528 00000100:00100000:1.0:1787388263.188817:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925782528 00000100:00100000:1.0:1787388263.188830:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925781888 00000100:00100000:1.0:1787388263.188832:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925781888 00000100:00100000:3.0:1787388263.188921:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925782272 00000100:00100000:3.0:1787388263.188925:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925782272 00000100:00100000:3.0:1787388263.188949:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925781632 00000100:00100000:3.0:1787388263.188952:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925781632 00000100:00100000:3.0:1787388263.188966:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925782144 00000100:00100000:3.0:1787388263.188969:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925782144 00000100:00100000:3.0:1787388263.188985:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:3.0:1787388263.188994:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925782272:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388263.189060:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925782272:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 66us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388263.189067:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:3.0:1787388263.189082:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:3.0:1787388263.189088:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2401:x1874211925781632:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388263.189108:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2401:x1874211925781632:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 21us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388263.189120:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:3.0:1787388263.189132:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:3.0:1787388263.189137:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2401:x1874211925782144:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388263.189172:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2401:x1874211925782144:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 34us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388263.189178:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:1.0:1787388263.190701:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925782400 00000100:00100000:1.0:1787388263.190709:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925782400 00000100:00100000:1.0:1787388263.190752:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:1.0:1787388263.190760:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2401:x1874211925782016:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388263.190863:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2401:x1874211925782016:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 103us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388263.190886:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:1.0:1787388263.190903:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:1.0:1787388263.190910:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925782528:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388263.190936:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925782528:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388263.190941:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:1.0:1787388263.190952:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:1.0:1787388263.190958:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2401:x1874211925781888:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388263.190998:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2401:x1874211925781888:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 39us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388263.191004:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:1.0:1787388263.191016:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:1.0:1787388263.191022:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925782400:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388263.191044:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925782400:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 22us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388263.191050:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00080000:1.0:1787388263.191087:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388263.191092:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787388263.191094:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787388263.191096:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787388263.404732:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787388264.428982:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787388265.177926:0:20119:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc1a489340 00000020:00000080:0.0:1787388265.177941:0:20119:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787388265.177946:0:20119:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787388265.177954:0:20119:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1a48b5d0 20000000:00000080:0.0:1787388265.177961:0:20119:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996b48323800 uarg=0000000000000000 20000000:01000000:0.0:1787388265.178270:0:20119:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787388265.178282:0:20119:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787388265.178287:0:20119:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787388265.179035:0:20120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1787388265.179183:0:20119:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787388265.188097:0:20119:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787388265.188129:0:20119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188148:0:20119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b52f5d000/0x26817551a4475790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475789 expref: 23 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188156:0:20119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b40030000/0x26817551a447579e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475797 expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188163:0:20119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b52f4ea00/0x26817551a44757dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a44757d6 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188170:0:20119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a432f7800/0x26817551a4475877 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475870 expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188179:0:20119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996a432f6600/0x26817551a4475a8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81c2 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188186:0:20119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996b70076800/0x26817551a4475aca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8232 expref: 12 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188208:0:20119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188253:0:20119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b70076800/0x26817551a4475aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8232 expref: 12 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188266:0:20119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b70076800/0x26817551a4475aca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8232 expref: 12 pid: 17087 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388265.188281:0:20119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788288:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388265.188396:0:20119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a432f6600/0x26817551a4475a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81c2 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188404:0:20119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a432f6600/0x26817551a4475a8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81c2 expref: 12 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388265.188412:0:20119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788416:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388265.188439:0:20119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996a432f7800/0x26817551a4475877 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4475870 expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188446:0:20119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996a432f7800/0x26817551a4475877 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4475870 expref: 23 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388265.188454:0:20119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788544:0@lo:104: 00000100:00100000:3.0:1787388265.188488:0:20119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787388265.188513:0:20119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b52f4ea00/0x26817551a44757dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a44757d6 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188531:0:20119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b52f4ea00/0x26817551a44757dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a44757d6 expref: 23 pid: 17089 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388265.188539:0:20119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788672:0@lo:104: 00000100:00100000:3.0:1787388265.188561:0:20119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787388265.188581:0:20119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b40030000/0x26817551a447579e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4475797 expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188588:0:20119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b40030000/0x26817551a447579e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4475797 expref: 23 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388265.188596:0:20119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788800:0@lo:104: 00000100:00100000:3.0:1787388265.188616:0:20119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787388265.188632:0:20119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996b52f5d000/0x26817551a4475790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26817551a4475789 expref: 23 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388265.188639:0:20119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996b52f5d000/0x26817551a4475790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26817551a4475789 expref: 23 pid: 17087 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388265.188647:0:20119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788928:0@lo:104: 00000100:00100000:3.0:1787388265.188665:0:20119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388265.188675:0:20119:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b43075240 going to sleep for 11 seconds 00000100:00100000:2.0:1787388265.188744:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945788544 00000100:00100000:2.0:1787388265.188751:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945788544 00000100:00100000:2.0:1787388265.188787:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945788672 00000100:00100000:2.0:1787388265.188790:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945788672 00000100:00100000:2.0:1787388265.188798:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945788800 00000100:00100000:2.0:1787388265.188800:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945788800 00000100:00100000:2.0:1787388265.188808:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945788928 00000100:00100000:2.0:1787388265.188810:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945788928 00000100:00100000:2.0:1787388265.188843:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388265.188852:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43935c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+6:20119:x1874211945788544:12345-0@lo:104: 00010000:00010000:2.0:1787388265.188864:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.188928:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388265.188934:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43935c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+6:20119:x1874211945788544:12345-0@lo:104: Request processed in 83us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388265.188941:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388265.188958:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787388265.188964:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+5:20119:x1874211945788672:12345-0@lo:104: 00010000:00010000:2.0:1787388265.188971:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.188974:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388265.188980:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.188988:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f4fa00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787388265.188992:0:19469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189000:0:19469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388265.189007:0:19469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388265.189013:0:19469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388265.189024:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787388265.189029:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+5:20119:x1874211945788672:12345-0@lo:104: Request processed in 66us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388265.189035:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787388265.189038:0:19469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189044:0:19469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787388265.189046:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787388265.189050:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+4:20119:x1874211945788800:12345-0@lo:104: 00010000:00010000:2.0:1787388265.189056:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189063:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189069:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b52f4fa00/0x26817551a4475870 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475877 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189081:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388265.189084:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1787388265.189085:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388265.189088:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+4:20119:x1874211945788800:12345-0@lo:104: Request processed in 38us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388265.189093:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787388265.189100:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b52f5d800 already unused, calling callback (ffffffffc12ddc20) 00000100:00100000:2.0:1787388265.189103:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:00010000:0.0:1787388265.189104:0:19469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388265.189108:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:20119:x1874211945788928:12345-0@lo:104: 00010000:00010000:0.0:1787388265.189111:0:19469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.189113:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388265.189117:0:19469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388265.189122:0:19469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787388265.189134:0:19469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.189135:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787388265.189139:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+3:20119:x1874211945788928:12345-0@lo:104: Request processed in 32us (474us total) trans 0 rc 0/0 00010000:00010000:0.0:1787388265.189140:0:19469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787388265.189144:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787388265.189152:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189158:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b52f5d800/0x26817551a44757d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a44757dd expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.189161:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787388265.189165:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189167:0:19469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787388265.189170:0:19469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189175:0:19469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6800 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:0.0:1787388265.189178:0:19469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.189181:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b40030c00 already unused, calling callback (ffffffffc12ddc20) 10000000:00010000:2.0:1787388265.189184:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.189190:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189193:0:19469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787388265.189198:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787388265.189200:0:19469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388265.189203:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787388265.189205:0:19469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787388265.189217:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189217:0:19469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.189223:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787388265.189223:0:19469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787388265.189230:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189230:0:19469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.189237:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996b40030c00/0x26817551a4475797 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a447579e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189237:0:19469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff996a432f6800/0x26817551a4475789 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26817551a4475790 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.189246:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388265.189247:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787388265.189249:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388265.189250:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388265.189251:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388265.189252:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787388265.189256:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388265.189258:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945789056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388265.189285:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388265.189332:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388265.189339:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945789440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388265.189382:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388265.189407:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945789184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388265.189427:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388265.189440:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787388265.189453:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4223df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945789312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388265.189474:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388265.189597:0:20119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788544:0@lo:104: 00000100:00100000:2.0:1787388265.189602:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945789056 00000100:00100000:3.0:1787388265.189607:0:20119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788672:0@lo:104: 00000100:00100000:3.0:1787388265.189614:0:20119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788800:0@lo:104: 00000100:00100000:2.0:1787388265.189615:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945789056 00000100:00100000:3.0:1787388265.189621:0:20119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788928:0@lo:104: 00010000:00010000:2.0:1787388265.189632:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a432f7800/0x26817551a4475877 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475870 expref: 24 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388265.190121:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945789440 00000100:00100000:2.0:1787388265.190126:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945789440 00010000:00010000:2.0:1787388265.190141:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b40030000/0x26817551a447579e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475797 expref: 25 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388265.190152:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945789184 00000100:00100000:2.0:1787388265.190154:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945789184 00010000:00010000:2.0:1787388265.190162:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b52f4ea00/0x26817551a44757dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44757d6 expref: 26 pid: 17089 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388265.190171:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945789312 00000100:00100000:2.0:1787388265.190173:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945789312 00010000:00010000:2.0:1787388265.190180:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b52f5d000/0x26817551a4475790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475789 expref: 27 pid: 17087 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388265.190189:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388265.190195:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+27:3652:x1874211945789056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388265.190206:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388265.190211:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a432f7800/0x26817551a4475877 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475870 expref: 27 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.190220:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a432f7800/0x26817551a4475877 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4475870 expref: 27 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.190233:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a432f7800/0x26817551a4475877 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4475870 expref: 27 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.190243:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388265.190284:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+26:3652:x1874211945789056:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388265.190299:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787388265.190313:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787388265.190405:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945789056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388265.190573:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+25:3652:x1874211945789440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388265.190581:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388265.190586:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b40030000/0x26817551a447579e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475797 expref: 25 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.190593:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b40030000/0x26817551a447579e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4475797 expref: 25 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.190614:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b40030000/0x26817551a447579e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4475797 expref: 25 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.190624:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388265.190658:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3652:x1874211945789440:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388265.190760:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3652:1874211945789440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787388265.190892:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787388265.190908:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787388265.190916:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:3649:x1874211945789184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388265.190924:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388265.190928:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b52f4ea00/0x26817551a44757dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a44757d6 expref: 23 pid: 17089 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.190937:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b52f4ea00/0x26817551a44757dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a44757d6 expref: 23 pid: 17089 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.190945:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b52f4ea00/0x26817551a44757dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a44757d6 expref: 23 pid: 17089 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.190963:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388265.191003:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:3649:x1874211945789184:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388265.191009:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787388265.191021:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787388265.191027:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:3649:x1874211945789312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787388265.191034:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388265.191038:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b52f5d000/0x26817551a4475790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26817551a4475789 expref: 21 pid: 17087 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.191046:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b52f5d000/0x26817551a4475790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26817551a4475789 expref: 21 pid: 17087 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.191056:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b52f5d000/0x26817551a4475790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26817551a4475789 expref: 21 pid: 17087 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.191065:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388265.191085:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:3649:x1874211945789312:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388265.191090:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787388265.191203:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945789312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787388265.191224:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4223e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3649:1874211945789184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787388265.195471:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388265.195567:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388265.195637:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925782784 00000100:00100000:0.0:1787388265.195647:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925782784 00010000:00010000:0.0:1787388265.195683:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996a432f6600/0x26817551a4475a8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81c2 expref: 13 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388265.195718:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925782656 00000100:00100000:0.0:1787388265.195722:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925782656 00010000:00010000:0.0:1787388265.195735:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996b70076800/0x26817551a4475aca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8232 expref: 14 pid: 17087 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388265.195755:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:0.0:1787388265.195764:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bcdc57b-3459-40d2-a2c1-acec130207c7+14:2401:x1874211925782784:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388265.195776:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388265.195782:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996a432f6600/0x26817551a4475a8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81c2 expref: 14 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.195793:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996a432f6600/0x26817551a4475a8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81c2 expref: 14 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.195823:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388265.195875:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bcdc57b-3459-40d2-a2c1-acec130207c7+14:2401:x1874211925782784:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 112us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388265.195890:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:0.0:1787388265.195933:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1787388265.195940:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:2401:x1874211925782656:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388265.195949:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388265.195953:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996b70076800/0x26817551a4475aca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8232 expref: 13 pid: 17087 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.195963:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996b70076800/0x26817551a4475aca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8232 expref: 13 pid: 17087 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.195974:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.195982:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.195996:0:17080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.196009:0:17080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.196016:0:17080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.196022:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.196029:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7000 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:0.0:1787388265.196040:0:17080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.196048:0:17080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.196056:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388265.196065:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787388265.196084:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:2401:x1874211925782656:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 145us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388265.196090:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00010000:00010000:1.0:1787388265.197197:0:20119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996b70076800/0x26817551a4475aca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8232 expref: 12 pid: 17087 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388265.197213:0:20119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788288:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388265.197225:0:20119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a432f6600/0x26817551a4475a8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81c2 expref: 11 pid: 17088 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388265.197234:0:20119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20119:1874211945788416:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388265.197266:0:20119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388265.197276:0:20119:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388265.197282:0:20119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388265.197288:0:20119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996a432f7000/0x26817551a4475afb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388265.452572:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388266.220867:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787388266.220891:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945789568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787388266.220963:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388266.221066:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945789568 00000100:00100000:1.0:1787388266.221076:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945789568 00000100:00100000:1.0:1787388266.221148:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787388266.221159:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945789568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787388266.221196:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787388266.221253:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945789568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388266.221259:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787388266.221442:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787388266.221922:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945789568:0@lo:13:osp-pre-0-1.0 10000000:01000000:2.0:1787388266.351855:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787388266.351863:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996a42cab000 from 13 10000000:01000000:2.0:1787388266.351868:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388266.351916:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e5a00/0x26817551a4475b02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388266.351946:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a431e5a00/0x26817551a4475b02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388266.351958:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a431e5a00/0x26817551a4475b02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388266.351992:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945789696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388266.352062:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388266.352107:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388266.352300:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945789696 00000100:00100000:1.0:1787388266.352310:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945789696 00000100:00100000:1.0:1787388266.352434:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787388266.352444:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+20:17091:x1874211945789696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388266.352456:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388266.352471:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70076c00/0x26817551a4475b09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475b02 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.352493:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70076c00/0x26817551a4475b09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475b02 expref: 21 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.352503:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70076c00/0x26817551a4475b09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475b02 expref: 21 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.352512:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076c00, rc 0) 00000100:00100000:1.0:1787388266.352553:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:17091:x1874211945789696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388266.352560:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787388266.355512:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945789696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787388266.355538:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a431e5a00/0x26817551a4475b02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b09 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388266.355551:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a431e5a00/0x26817551a4475b02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475b09 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388266.355742:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945789824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388266.355798:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388266.355842:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388266.356552:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945789824 00000100:00100000:0.0:1787388266.356562:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945789824 00000100:00100000:0.0:1787388266.357117:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787388266.357129:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:17091:x1874211945789824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388266.357285:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:17091:x1874211945789824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388266.357293:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787388266.357337:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945789824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787388266.357424:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945789952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388266.357464:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388266.357490:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787388266.357545:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945789952 00000100:00100000:1.0:1787388266.357551:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945789952 00000100:00100000:1.0:1787388266.357586:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787388266.357593:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:17091:x1874211945789952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.357868:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:17091:x1874211945789952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388266.357875:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787388266.358438:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945789952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787388266.360768:0:20157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787388266.360890:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787388266.360919:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787388266.360941:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e5a00/0x26817551a4475b02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b09 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388266.360951:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a431e5a00/0x26817551a4475b02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b09 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787388266.360961:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787388266.360964:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b7b0b8800 from 13 10000000:01000000:2.0:1787388266.360967:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787388266.361005:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a4475b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388266.361014:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a4475b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388266.361024:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a4475b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388266.361046:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787388266.361118:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388266.361931:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b517ce180 going to sleep for 11 seconds 00000100:00100000:0.0:1787388266.362202:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945790080 00000100:00100000:0.0:1787388266.362211:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945790080 00000100:00100000:0.0:1787388266.362269:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787388266.362279:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+21:17091:x1874211945790080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388266.362293:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388266.362319:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b74e09600/0x26817551a4475b17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475b10 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388266.362372:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b74e09600/0x26817551a4475b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475b10 expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388266.362383:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b74e09600/0x26817551a4475b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475b10 expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388266.362393:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09600, rc 0) 00000100:00100000:0.0:1787388266.362447:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:17091:x1874211945790080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388266.362454:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787388266.362506:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787388266.362520:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a4475b10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b17 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388266.362528:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a4475b10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475b17 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388266.362602:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388266.362631:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388266.362647:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b5dd68b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787388266.362660:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945790208 00000100:00100000:0.0:1787388266.362663:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945790208 00000100:00100000:0.0:1787388266.362683:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787388266.362690:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:17091:x1874211945790208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787388266.362795:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:17091:x1874211945790208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388266.362812:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787388266.362830:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.362866:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.362916:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388266.362943:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787388266.363063:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945790336 00000100:00100000:0.0:1787388266.363068:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945790336 00000100:00100000:0.0:1787388266.363100:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787388266.363107:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a432eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:17091:x1874211945790336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388266.363185:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a432eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:17091:x1874211945790336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388266.363192:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787388266.363235:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787388266.373435:0:20158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787388266.373671:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787388266.373704:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787388266.373716:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a4475b10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b17 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388266.373728:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a431e5400/0x26817551a4475b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b17 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787388266.373739:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787388266.373742:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996b73a8a800 from 13 10000000:01000000:3.0:1787388266.373745:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787388266.373784:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f7200/0x26817551a4475b1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388266.373792:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996a432f7200/0x26817551a4475b1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388266.373803:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996a432f7200/0x26817551a4475b1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388266.373846:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787388266.373912:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388266.373956:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b430759c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787388266.374285:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945790464 00000100:00100000:1.0:1787388266.374293:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945790464 00000100:00100000:1.0:1787388266.374436:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787388266.374448:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+22:17091:x1874211945790464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388266.374462:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388266.374477:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70077200/0x26817551a4475b25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475b1e expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.374501:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70077200/0x26817551a4475b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475b1e expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.374513:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70077200/0x26817551a4475b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475b1e expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.374521:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077200, rc 0) 00000100:00100000:1.0:1787388266.374571:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:17091:x1874211945790464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388266.374578:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787388266.374636:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388266.374651:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996a432f7200/0x26817551a4475b1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b25 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.374660:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996a432f7200/0x26817551a4475b1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475b25 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388266.374730:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.374758:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388266.374782:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1787388266.374862:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945790592 00000100:00100000:3.0:1787388266.374867:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945790592 00000100:00100000:3.0:1787388266.374909:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787388266.374916:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:17091:x1874211945790592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388266.375051:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:17091:x1874211945790592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388266.375058:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787388266.375202:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.375231:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.375273:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388266.375312:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1787388266.375691:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945790720 00000100:00100000:3.0:1787388266.375697:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945790720 00000100:00100000:3.0:1787388266.375773:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787388266.375782:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:17091:x1874211945790720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787388266.375889:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:17091:x1874211945790720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388266.375896:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787388266.376316:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787388266.377254:0:20160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787388266.378527:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787388266.378553:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787388266.378563:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996a432f7200/0x26817551a4475b1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b25 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388266.378576:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996a432f7200/0x26817551a4475b1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b25 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787388266.378639:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787388266.378642:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996a44056800 from 13 10000000:01000000:0.0:1787388266.378645:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787388266.378676:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09800/0x26817551a4475b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388266.378684:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff996b74e09800/0x26817551a4475b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388266.378694:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff996b74e09800/0x26817551a4475b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388266.378727:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787388266.378779:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388266.378815:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72bc8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787388266.378946:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945790848 00000100:00100000:3.0:1787388266.378953:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945790848 00000100:00100000:3.0:1787388266.379006:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787388266.379013:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+23:17091:x1874211945790848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388266.379025:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388266.379036:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f6200/0x26817551a4475b33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26817551a4475b2c expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388266.379056:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f6200/0x26817551a4475b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26817551a4475b2c expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388266.379066:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f6200/0x26817551a4475b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26817551a4475b2c expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388266.379075:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6200, rc 0) 00000100:00100000:3.0:1787388266.380814:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:17091:x1874211945790848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1792us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388266.380846:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787388266.381066:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388266.381089:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff996b74e09800/0x26817551a4475b2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b33 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.381101:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff996b74e09800/0x26817551a4475b2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26817551a4475b33 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388266.381176:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.381221:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388266.381256:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787388266.381300:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945790976 00000100:00100000:3.0:1787388266.381306:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945790976 00000100:00100000:3.0:1787388266.381436:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787388266.381445:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:17091:x1874211945790976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388266.381555:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:17091:x1874211945790976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388266.381563:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787388266.381659:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945790976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.381685:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945791104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.381722:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388266.390677:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787388266.399947:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945791104 00000100:00100000:2.0:1787388266.399961:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945791104 00000100:00100000:2.0:1787388266.400082:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787388266.400092:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:17091:x1874211945791104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787388266.400262:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:17091:x1874211945791104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (18538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388266.400270:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787388266.400361:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae525cec-d184-4a5a-bf65-8c20a2a658d5:17091:1874211945791104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787388266.402488:0:20163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787388266.402582:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787388266.402604:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787388266.402615:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff996b74e09800/0x26817551a4475b2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b33 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388266.402627:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff996b74e09800/0x26817551a4475b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26817551a4475b33 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.479536:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388266.635152:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388266.635187:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925782912 00000100:00100000:3.0:1787388266.635196:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925782912 00000100:00100000:3.0:1787388266.635244:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 158 00000100:00100000:3.0:1787388266.635254:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+11:14931:x1874211925782912:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787388266.635272:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388266.635289:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996a432f6c00/0x26817551a4475b3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe826a expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388266.635317:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996a432f6c00/0x26817551a4475b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe826a expref: 12 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388266.635329:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996a432f6c00/0x26817551a4475b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe826a expref: 12 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388266.635339:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6c00, rc 0) 00000100:00100000:3.0:1787388266.635410:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+12:14931:x1874211925782912:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 156us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388266.635417:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 158 00000100:00100000:1.0:1787388266.638107:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388266.638174:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925783040 00000100:00100000:3.0:1787388266.638184:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925783040 00000100:00100000:3.0:1787388266.638236:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 159 00000100:00100000:3.0:1787388266.638245:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+12:14931:x1874211925783040:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787388266.638412:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+12:14931:x1874211925783040:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 167us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388266.638422:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 159 00000100:00100000:1.0:1787388266.645953:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388266.646000:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925783168 00000100:00100000:1.0:1787388266.646009:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925783168 00000100:00100000:1.0:1787388266.646058:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 160 00000100:00100000:1.0:1787388266.646067:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+12:14931:x1874211925783168:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.646196:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+12:14931:x1874211925783168:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 129us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388266.646205:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 160 00000100:00100000:3.0:1787388266.661886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388266.662073:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925783296 00000100:00100000:1.0:1787388266.662083:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925783296 00000100:00100000:1.0:1787388266.662135:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 161 00000100:00100000:1.0:1787388266.662145:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+12:14931:x1874211925783296:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787388266.662160:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388266.662178:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996b70076000/0x26817551a4475b41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8271 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.662205:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996b70076000/0x26817551a4475b41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8271 expref: 13 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.662216:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996b70076000/0x26817551a4475b41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8271 expref: 13 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388266.662225:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076000, rc 0) 00000100:00100000:1.0:1787388266.662289:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:14931:x1874211925783296:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 145us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388266.662319:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 161 00000100:00100000:1.0:1787388266.672234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388266.672271:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925783424 00000100:00100000:1.0:1787388266.672280:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925783424 00000100:00100000:1.0:1787388266.672333:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:1.0:1787388266.672343:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:14931:x1874211925783424:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787388266.672525:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:14931:x1874211925783424:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 182us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388266.672534:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:1.0:1787388266.677590:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388266.678512:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925783552 00000100:00100000:0.0:1787388266.678524:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925783552 00000100:00100000:0.0:1787388266.678575:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 163 00000100:00100000:0.0:1787388266.678584:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:14931:x1874211925783552:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787388266.678717:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:14931:x1874211925783552:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 133us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388266.678725:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 163 00000100:00100000:1.0:1787388267.245643:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945791360:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.245709:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.245736:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945791872:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.245753:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.245767:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945792384:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.245792:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.245828:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787388267.245834:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945791232:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.245862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.245887:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945791744:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.245908:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.245924:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945792256:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.245945:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.245972:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b52ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945792768:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.246120:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.246143:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945791616:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.246166:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.246254:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945792128:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.246277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.246295:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945792640:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.246314:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.246326:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787388267.246332:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945791488:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.246376:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.246393:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945792000:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.246414:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.246430:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945792512:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.246449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.246470:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945791360 00000100:00100000:1.0:1787388267.246477:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945791360 00000100:00100000:1.0:1787388267.246510:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945791872 00000100:00100000:1.0:1787388267.246512:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945791872 00000100:00100000:1.0:1787388267.246527:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787388267.246534:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945791360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.246582:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945791360:12345-0@lo:400:kworker.0 Request processed in 48us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388267.246589:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787388267.246603:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787388267.246607:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945791872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.246643:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945791872:12345-0@lo:400:kworker.0 Request processed in 35us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388267.246649:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787388267.246667:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945791232 00000100:00100000:1.0:1787388267.246670:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945791232 00000100:00100000:1.0:1787388267.246692:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787388267.246698:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3650:x1874211945791232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.246725:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3650:x1874211945791232:12345-0@lo:400:kworker.0 Request processed in 27us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388267.246730:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787388267.247523:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945793024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787388267.247558:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388267.247599:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945793024 00000100:00100000:2.0:1787388267.247603:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945793024 00000100:00100000:2.0:1787388267.247648:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787388267.247655:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945793024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787388267.247678:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787388267.247712:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945793024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388267.247718:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787388267.247763:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945793024:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787388267.247810:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388267.247835:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945792384 00000100:00100000:2.0:1787388267.247840:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945792384 00000100:00100000:2.0:1787388267.247864:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945791744 00000100:00100000:2.0:1787388267.247868:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945791744 00000100:00100000:2.0:1787388267.247880:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945792256 00000100:00100000:2.0:1787388267.247883:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945792256 00000100:00100000:2.0:1787388267.247893:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945792768 00000100:00100000:2.0:1787388267.247904:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945792768 00000100:00100000:2.0:1787388267.247919:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945792640 00000100:00100000:2.0:1787388267.247922:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945792640 00000100:00100000:2.0:1787388267.247934:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945792512 00000100:00100000:2.0:1787388267.247936:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945792512 00000100:00100000:2.0:1787388267.247948:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787388267.247954:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945792384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388267.247996:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945792384:12345-0@lo:400:kworker.0 Request processed in 32us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388267.248003:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787388267.248016:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787388267.248022:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945791744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388267.248049:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874211945791744:12345-0@lo:400:kworker.0 Request processed in 27us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388267.248055:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787388267.248066:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787388267.248071:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945792256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388267.248097:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874211945792256:12345-0@lo:400:kworker.0 Request processed in 26us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388267.248103:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787388267.248114:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787388267.248120:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945792768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388267.248144:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874211945792768:12345-0@lo:400:kworker.0 Request processed in 25us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388267.248150:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787388267.248160:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388267.248165:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945792640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388267.249135:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945792640:12345-0@lo:400:kworker.0 Request processed in 965us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388267.249143:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388267.249162:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787388267.249170:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945792512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388267.249275:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874211945792512:12345-0@lo:400:kworker.0 Request processed in 106us (2824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388267.249281:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787388267.249302:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787388267.249306:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787388267.249335:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996a4390ad80 x1874211945792512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787388267.249363:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1874211945792512:0@lo:400:kworker.0 00000100:00100000:2.0:1787388267.249378:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945792640:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.249592:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945791616 00000100:00100000:1.0:1787388267.249599:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945791616 00000100:00100000:1.0:1787388267.249636:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945792128 00000100:00100000:1.0:1787388267.249639:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945792128 00000100:00100000:1.0:1787388267.249650:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945791488 00000100:00100000:1.0:1787388267.249652:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945791488 00000100:00100000:1.0:1787388267.249662:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945792000 00000100:00100000:1.0:1787388267.249665:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945792000 00000100:00100000:1.0:1787388267.249676:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787388267.249682:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945791616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.249719:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945791616:12345-0@lo:400:kworker.0 Request processed in 37us (3552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388267.249725:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787388267.249735:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787388267.249739:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945792128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.249760:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945792128:12345-0@lo:400:kworker.0 Request processed in 21us (3483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388267.249777:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787388267.249787:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787388267.249792:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945791488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.249828:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945791488:12345-0@lo:400:kworker.0 Request processed in 36us (3452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388267.249834:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787388267.249843:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787388267.249848:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945792000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.249870:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945792000:12345-0@lo:400:kworker.0 Request processed in 22us (3456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388267.249875:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787388267.249909:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945792896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787388267.249940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388267.249965:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945791232:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.249977:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874211945791744:0@lo:400:kworker.0 00000100:00080000:2.0:1787388267.251456:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388267.251462:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388267.251468:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787388267.251486:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945793152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388267.251538:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388267.251581:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945792896 00000100:00100000:2.0:1787388267.251587:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945792896 00000100:00100000:2.0:1787388267.251621:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787388267.251628:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945792896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787388267.251646:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787388267.251682:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945792896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388267.251698:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787388267.251738:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945791488:0@lo:400:kworker.0 00000100:00100000:2.0:1787388267.251750:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945792000:0@lo:400:kworker.0 00000100:00100000:2.0:1787388267.251761:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945791616:0@lo:400:kworker.0 00000100:00100000:2.0:1787388267.251773:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945792128:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.252088:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874211945792256:0@lo:400:kworker.0 00010000:00080000:1.0:1787388267.252108:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b52ef1f80 x1874211945792768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787388267.252117:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b52ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1874211945792768:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.252127:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945791360:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.252137:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945791872:0@lo:400:kworker.0 00000100:00100000:1.0:1787388267.252147:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945792384:0@lo:400:kworker.0 00000100:00100000:3.0:1787388267.252397:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945793280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787388267.252432:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388267.252462:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945793280 00000100:00100000:3.0:1787388267.252466:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945793280 00000100:00100000:3.0:1787388267.252491:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787388267.252498:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945793280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388267.252509:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787388267.252538:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945793280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388267.252545:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787388267.252571:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945793280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388267.253261:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945792896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787388267.254074:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945793152 00000100:00100000:0.0:1787388267.254081:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945793152 00000100:00100000:0.0:1787388267.254126:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787388267.254134:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945793152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787388267.254162:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787388267.254478:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945793152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 344us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388267.254486:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787388267.254526:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945793152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787388267.254825:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945793408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388267.254860:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388267.257124:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945793408 00000100:00100000:2.0:1787388267.257137:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945793408 00000100:00100000:2.0:1787388267.257189:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787388267.257199:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945793408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787388267.257234:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787388267.257315:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945793408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388267.257322:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787388267.257391:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945793408:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787388267.502257:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787388268.206154:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787388268.306840:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388268.306893:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388268.306926:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388268.306969:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388268.307012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388268.307038:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925783680 00000100:00100000:1.0:1787388268.307044:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388268.307067:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925783680 00000100:00100000:3.0:1787388268.307115:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925784192 00000100:00100000:3.0:1787388268.307126:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925784192 00000100:00100000:0.0:1787388268.307160:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 165 00000100:00100000:3.0:1787388268.307207:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925784704 00000100:00100000:3.0:1787388268.307214:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925784704 00000100:00100000:3.0:1787388268.307240:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1787388268.307249:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2400:x1874211925784192:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388268.307413:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2400:x1874211925784192:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 162us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388268.307438:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:2400:x1874211925783680:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388268.307447:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1787388268.307474:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1787388268.307484:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2400:x1874211925784704:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388268.307538:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:2400:x1874211925783680:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 366us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388268.307547:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 165 00000100:00100000:3.0:1787388268.313693:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2400:x1874211925784704:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 6193us (6664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388268.313712:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00080000:3.0:1787388268.313779:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787388268.318328:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925783936 00000100:00100000:2.0:1787388268.318344:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925783936 00000100:00100000:2.0:1787388268.318438:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925784448 00000100:00100000:2.0:1787388268.318442:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925784448 00000100:00100000:2.0:1787388268.318459:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925783808 00000100:00100000:2.0:1787388268.318462:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925783808 00000100:00100000:2.0:1787388268.318482:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:2.0:1787388268.318491:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2400:x1874211925783936:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388268.318567:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2400:x1874211925783936:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 75us (11672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.318589:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:2.0:1787388268.318613:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:2.0:1787388268.318623:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2400:x1874211925784448:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388268.318705:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388268.318841:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388268.318860:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00080000:3.0:1787388268.318919:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787388268.318925:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787388268.318950:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925784064 00000100:00100000:3.0:1787388268.318957:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925784064 00000100:00100000:3.0:1787388268.319011:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925784576 00000100:00100000:3.0:1787388268.319016:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925784576 00000100:00100000:3.0:1787388268.319041:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:3.0:1787388268.319051:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2400:x1874211925784064:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388268.319114:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2400:x1874211925784064:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 65us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388268.319122:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:3.0:1787388268.319138:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:0.0:1787388268.319844:0:17094:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787388268.320123:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2400:x1874211925784576:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1787388268.320251:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2400:x1874211925784576:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 138us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388268.320279:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1787388268.320828:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2400:x1874211925784448:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 2007us (13659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.320839:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:2.0:1787388268.320863:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925784320 00000100:00100000:2.0:1787388268.320869:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925784320 00000100:00100000:2.0:1787388268.320902:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:2.0:1787388268.320909:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b52ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2400:x1874211925783808:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388268.320940:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b52ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2400:x1874211925783808:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 31us (13899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.320947:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:2.0:1787388268.322156:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1787388268.322176:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2400:x1874211925784320:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388268.322237:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2400:x1874211925784320:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 70us (3395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.322245:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00080000:2.0:1787388268.322298:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787388268.322303:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388268.325816:0:17094:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00010000:2.0:1787388268.524730:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388268.963324:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388268.963538:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925784832 00000100:00100000:2.0:1787388268.963551:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925784832 00000100:00100000:2.0:1787388268.963644:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1787388268.963656:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:15599:x1874211925784832:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388268.963700:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388268.963729:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8278 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.963823:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.963840:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.963855:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.963872:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.963879:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.963886:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.963985:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4475b5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.963993:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4475b5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964001:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4475b5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388268.964039:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787388268.964050:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388268.964094:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4475b5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964107:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964114:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964122:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964128:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4e00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388268.964133:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964141:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964155:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48700) 00010000:00010000:2.0:1787388268.964159:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388268.964163:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964170:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964187:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964193:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964210:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964215:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388268.964219:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964225:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964234:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff996b4a814500) 00010000:00010000:2.0:1787388268.964237:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388268.964240:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964246:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964283:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8278 expref: 8 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964297:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4a00/0x26817551a4475b5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8278 expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.964304:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996b4a814d00) 00010000:00010000:2.0:1787388268.964572:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787388268.964577:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4a00, rc 0) 00000100:00100000:2.0:1787388268.964665:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:15599:x1874211925784832:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1011us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.964684:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:0.0:1787388268.983737:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388268.983858:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925784960 00000100:00100000:2.0:1787388268.983870:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925784960 00000100:00100000:2.0:1787388268.983945:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:2.0:1787388268.983957:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:15599:x1874211925784960:12345-192.168.203.15@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787388268.984070:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:15599:x1874211925784960:12345-192.168.203.15@tcp:900:lhsmtool_posix.0 Request processed in 114us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388268.984079:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:1.0:1787388268.987454:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388268.987569:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925785216 00000100:00100000:2.0:1787388268.987586:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925785216 00000100:00100000:2.0:1787388268.987680:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:2.0:1787388268.987695:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:15599:x1874211925785216:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787388268.987725:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388268.987753:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe827f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.987866:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b6b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.987883:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.987897:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.989876:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b72 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.989916:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.989930:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.990059:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4600/0x26817551a4475b79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.990068:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4600/0x26817551a4475b79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.990075:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4600/0x26817551a4475b79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388268.990087:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787388268.992729:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992745:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b6b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992752:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b6b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992758:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5200 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388268.992762:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b6b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992770:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b6b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992815:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996b4a814d00) 00010000:00010000:2.0:1787388268.992819:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388268.992823:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b6b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992830:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5200/0x26817551a4475b6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992845:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992851:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b72 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992857:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992862:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4e00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388268.992865:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992871:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b72 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992878:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff996b4a814500) 00010000:00010000:2.0:1787388268.992881:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388268.992883:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b72 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388268.992889:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4e00/0x26817551a4475b72 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.003538:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe827f expref: 10 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.003568:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4600/0x26817551a4475b79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe827f expref: 9 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.003578:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b4a814900) 00010000:00010000:2.0:1787388269.003581:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388269.003585:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4600, rc 0) 00000100:00100000:2.0:1787388269.003648:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+9:15599:x1874211925785216:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 15957us (16203us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787388269.003659:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:3.0:1787388269.023970:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388269.024078:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925785344 00000100:00100000:2.0:1787388269.024089:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925785344 00000100:00100000:2.0:1787388269.024147:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:2.0:1787388269.024157:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+9:15599:x1874211925785344:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787388269.024266:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+9:15599:x1874211925785344:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 109us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388269.024284:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1787388269.030651:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.030721:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925785472 00000100:00100000:3.0:1787388269.030731:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925785472 00000100:00100000:3.0:1787388269.030794:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:3.0:1787388269.030813:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:15599:x1874211925785472:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1787388269.034066:0:20233:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3209us 00000100:00100000:1.0:1787388269.034284:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.034372:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925785600 00000100:00100000:3.0:1787388269.034381:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925785600 00000100:00100000:3.0:1787388269.034439:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:3.0:1787388269.034450:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+9:15605:x1874211925785600:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388269.034469:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388269.034491:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8286 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034598:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475b8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034612:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034624:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034681:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475b95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034701:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034708:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034748:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034756:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475b8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034763:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034769:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388269.034773:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034780:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475b8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034791:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48700) 00010000:00010000:3.0:1787388269.034795:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388269.034799:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475b8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034818:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034829:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034842:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475b95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034848:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034853:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388269.034856:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034862:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475b95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034870:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996a43284000) 00010000:00010000:3.0:1787388269.034872:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388269.034875:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475b95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034881:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475b95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034913:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475b87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8286 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034922:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48700) 00010000:00010000:3.0:1787388269.034925:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388269.034928:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8286 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.034948:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6600, rc 0) 00000100:00100000:3.0:1787388269.035015:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+9:15605:x1874211925785600:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 567us (734us total) trans 0 rc 301/301 00000100:00100000:3.0:1787388269.035023:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:1.0:1787388269.042029:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.042126:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925785728 00000100:00100000:3.0:1787388269.042136:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925785728 00000100:00100000:3.0:1787388269.042193:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:3.0:1787388269.042206:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+9:15605:x1874211925785728:12345-192.168.203.15@tcp:700:lfs.0 00000100:00100000:3.0:1787388269.042294:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+9:15605:x1874211925785728:12345-192.168.203.15@tcp:700:lfs.0 Request processed in 93us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388269.042302:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1787388269.052216:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388269.052736:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925785984 00000100:00100000:2.0:1787388269.052747:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925785984 00000100:00100000:2.0:1787388269.052856:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:2.0:1787388269.052866:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+9:15605:x1874211925785984:12345-192.168.203.15@tcp:36:lfs.0 00010000:00010000:2.0:1787388269.053393:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388269.053421:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ab5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe81f3 expref: 9 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.053452:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48700) 00010000:00010000:2.0:1787388269.053457:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388269.053511:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.053525:0:17094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8263 expref: 5 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.053533:0:17094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.053592:0:17094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8263 expref: 5 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.053607:0:17094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8263 expref: 5 pid: 17095 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388269.053622:0:17094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17094:1874211945793536:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388269.053706:0:17094:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b4533c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787388269.058370:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388269.058399:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925786112 00000100:00100000:0.0:1787388269.058407:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925786112 00010000:00010000:0.0:1787388269.058446:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8263 expref: 6 pid: 17095 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388269.058480:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1787388269.058490:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2402:x1874211925786112:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787388269.058503:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388269.058510:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8263 expref: 6 pid: 17095 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388269.058521:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8263 expref: 6 pid: 17095 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388269.058526:0:17094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17094:1874211945793536:192.168.203.15@tcp:104: 00010000:00010000:0.0:1787388269.058541:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08e00/0x26817551a4475af4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8263 expref: 6 pid: 17095 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.058547:0:17094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388269.058564:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48700) 00010000:00010000:0.0:1787388269.058569:0:17080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388269.058579:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388269.058587:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388269.060138:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:15599:x1874211925785472:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 29329us (29489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388269.060149:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 26 00010000:00010000:1.0:1787388269.060716:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388269.060758:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2402:x1874211925786112:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 2268us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.060767:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00010000:00010000:3.0:1787388269.060870:0:17094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.060979:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.061008:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.061019:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.061028:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064618:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064639:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064651:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388269.064669:0:17094:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008de26382 reply state 000000006aeef76b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064681:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064688:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:2.0:1787388269.064691:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388269.064696:0:17094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787388269.064701:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787388269.064718:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064725:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064732:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064738:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388269.064742:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064750:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064762:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48700) 00010000:00010000:2.0:1787388269.064764:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388269.064768:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064774:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5800/0x26817551a4475b9c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388269.064793:0:17094:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008de26382 reply state 000000006aeef76b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064812:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388269.064819:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996a43284000) 00010000:00010000:2.0:1787388269.064821:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388269.064830:0:17094:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787388269.064993:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+10:15605:x1874211925785984:12345-192.168.203.15@tcp:36:lfs.0 Request processed in 12124us (12781us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787388269.065001:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:2.0:1787388269.160950:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388269.161116:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925786240 00000100:00100000:1.0:1787388269.161126:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925786240 00000100:00100000:1.0:1787388269.161200:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:1.0:1787388269.161210:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+10:15613:x1874211925786240:12345-192.168.203.15@tcp:101:lctl.0 00010000:00010000:1.0:1787388269.161234:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388269.161258:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe828d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.161341:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076800/0x26817551a4475bb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.161396:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076800/0x26817551a4475bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.161407:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076800/0x26817551a4475bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388269.161455:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388269.161458:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388269.161490:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076800/0x26817551a4475bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.161514:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe828d expref: 12 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.161531:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076800/0x26817551a4475bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe828d expref: 11 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.161539:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48400) 00010000:00010000:1.0:1787388269.161542:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388269.161545:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076800, rc 0) 00000100:00100000:1.0:1787388269.161598:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+11:15613:x1874211925786240:12345-192.168.203.15@tcp:101:lctl.0 Request processed in 390us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.161605:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000040:00080000:3.0:1787388269.165613:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787388269.206623:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.206714:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925786368 00000100:00100000:3.0:1787388269.206724:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925786368 00000100:00100000:3.0:1787388269.206783:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:3.0:1787388269.206792:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:15614:x1874211925786368:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388269.206821:0:20233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388269.206841:0:20233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8294 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.206917:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475bc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.206930:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.206941:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388269.207013:0:20233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787388269.207017:0:20233:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388269.207048:0:20233:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.207070:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8294 expref: 7 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.207083:0:20233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6800/0x26817551a4475bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8294 expref: 6 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.207089:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48400) 00010000:00010000:3.0:1787388269.207091:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787388269.207093:0:20233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6800, rc 0) 00000100:00100000:3.0:1787388269.207145:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:15614:x1874211925786368:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 355us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388269.207149:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:2.0:1787388269.210820:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388269.210915:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925786496 00000100:00100000:1.0:1787388269.210939:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925786496 00000100:00100000:1.0:1787388269.211051:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:1.0:1787388269.211061:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:15614:x1874211925786496:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388269.211081:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388269.211100:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe829b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211161:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475bd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211174:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211185:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211475:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475bdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211485:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211493:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211575:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475be2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211584:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475be2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211590:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475be2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388269.211635:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388269.211639:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388269.211657:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475be2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211670:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211677:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475bd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211683:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211688:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388269.211692:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211699:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211711:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48400) 00010000:00010000:1.0:1787388269.211713:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388269.211718:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475bd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211723:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475bd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211736:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211751:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475bdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211756:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211762:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388269.211765:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211772:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475bdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211780:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996a43284000) 00010000:00010000:1.0:1787388269.211782:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388269.211785:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475bdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211790:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475bdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211827:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475bcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe829b expref: 8 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211840:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475be2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe829b expref: 7 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.211848:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:1.0:1787388269.211850:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388269.211858:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077e00, rc 0) 00000100:00100000:1.0:1787388269.211938:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+7:15614:x1874211925786496:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 878us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.211946:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:0.0:1787388269.218922:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388269.219005:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925786624 00000100:00100000:2.0:1787388269.219014:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925786624 00000100:00100000:2.0:1787388269.219084:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:2.0:1787388269.219095:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:15614:x1874211925786624:12345-192.168.203.15@tcp:900:lfs.0 00000100:00100000:2.0:1787388269.219272:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:15614:x1874211925786624:12345-192.168.203.15@tcp:900:lfs.0 Request processed in 178us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388269.219282:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:2.0:1787388269.224004:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.224148:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925786880 00000100:00100000:3.0:1787388269.224159:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925786880 00000100:00100000:3.0:1787388269.224404:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:3.0:1787388269.224415:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+7:15614:x1874211925786880:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388269.224436:0:20233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388269.224455:0:20233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475be9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82a2 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388269.224550:0:20233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787388269.224640:0:20233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475be9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82a2 expref: 9 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.224667:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48400) 00010000:00010000:3.0:1787388269.224670:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388269.224676:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475be9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82a2 expref: 9 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.224690:0:20233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7800, rc 0) 00000100:00100000:3.0:1787388269.224737:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+8:15614:x1874211925786880:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 324us (742us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787388269.224743:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:3.0:1787388269.228104:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388269.228313:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925787136 00000100:00100000:0.0:1787388269.228321:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925787136 00000100:00100000:0.0:1787388269.228434:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:0.0:1787388269.228445:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+8:15614:x1874211925787136:12345-192.168.203.15@tcp:36:lfs.0 00010000:00010000:0.0:1787388269.228495:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787388269.228520:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475be2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe829b expref: 8 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388269.228538:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:0.0:1787388269.228542:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787388269.228562:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388269.228575:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388269.228584:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787388269.228774:0:17096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d38b781 reply state 00000000456ba9a9 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388269.228787:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388269.228793:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:0.0:1787388269.228796:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787388269.228798:0:17096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787388269.228830:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000040:00080000:2.0:1787388269.229101:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787388269.229497:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+9:15614:x1874211925787136:12345-192.168.203.15@tcp:36:lfs.0 Request processed in 456us (803us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787388269.229506:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:0.0:1787388269.234289:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388269.234424:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925787392 00000100:00100000:2.0:1787388269.234433:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925787392 00000100:00100000:2.0:1787388269.234499:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:2.0:1787388269.234510:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+9:15614:x1874211925787392:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388269.235022:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+10:15614:x1874211925787392:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 513us (741us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787388269.235031:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:2.0:1787388269.241633:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388269.241783:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925787648 00000100:00100000:1.0:1787388269.241794:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925787648 00000100:00100000:1.0:1787388269.241858:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:1.0:1787388269.241868:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+10:15614:x1874211925787648:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388269.242332:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388269.242379:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475bfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82a9 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242466:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242481:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242492:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242503:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242511:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242517:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388269.242613:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787388269.242711:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242720:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242726:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242732:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388269.242735:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242743:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242755:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48400) 00010000:00010000:1.0:1787388269.242758:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388269.242763:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242769:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242783:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242789:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242795:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242824:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388269.242827:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242833:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242842:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996a43284000) 00010000:00010000:1.0:1787388269.242845:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388269.242847:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.242853:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.243133:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475bfe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82a9 expref: 12 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.243145:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48400) 00010000:00010000:1.0:1787388269.243147:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388269.243151:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475bfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82a9 expref: 12 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.243160:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077c00, rc 0) 00000100:00100000:1.0:1787388269.243225:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+11:15614:x1874211925787648:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1358us (1602us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787388269.243234:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:3.0:1787388269.247832:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388269.248140:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925787776 00000100:00100000:1.0:1787388269.248163:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925787776 00000100:00100000:1.0:1787388269.248223:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:1.0:1787388269.248233:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+11:15614:x1874211925787776:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388269.248255:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388269.248273:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c1a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82b0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.248403:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.248418:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.248429:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388269.248455:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787388269.248459:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388269.248477:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.248502:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c1a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b0 expref: 13 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.248519:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b0 expref: 12 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.248527:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:1.0:1787388269.248530:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388269.248533:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077c00, rc 0) 00000100:00100000:1.0:1787388269.248847:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+12:15614:x1874211925787776:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 614us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.248856:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:0.0:1787388269.260773:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.263110:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925787904 00000100:00100000:3.0:1787388269.263125:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925787904 00000100:00100000:3.0:1787388269.263371:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:3.0:1787388269.263383:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+12:15614:x1874211925787904:12345-192.168.203.15@tcp:37:lfs.0 00000100:00100000:3.0:1787388269.271285:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+12:15614:x1874211925787904:12345-192.168.203.15@tcp:37:lfs.0 Request processed in 7895us (10510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388269.271300:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:0.0:1787388269.278503:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388269.279131:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925788160 00000100:00100000:2.0:1787388269.279141:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925788160 00000100:00100000:2.0:1787388269.279263:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:2.0:1787388269.279273:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7d73f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+12:15614:x1874211925788160:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1787388269.279551:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7d73f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+13:15614:x1874211925788160:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 277us (1056us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787388269.279561:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:0.0:1787388269.363477:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.363570:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925788288 00000100:00100000:3.0:1787388269.363581:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925788288 00000100:00100000:3.0:1787388269.363640:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:3.0:1787388269.363650:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+11:15620:x1874211925788288:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1787388269.363670:0:20233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388269.363690:0:20233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475c28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82b7 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.363786:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c2f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.363808:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.363819:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.363830:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.363837:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.363844:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.363928:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475c3d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.363937:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475c3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.363943:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475c3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388269.363996:0:20233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787388269.364000:0:20233:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388269.364033:0:20233:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475c3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364056:0:20233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364062:0:20233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c2f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364069:0:20233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364075:0:20233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388269.364079:0:20233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364086:0:20233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c2f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364097:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48400) 00010000:00010000:3.0:1787388269.364101:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388269.364105:0:20233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364111:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364124:0:20233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364130:0:20233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c36 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364136:0:20233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364146:0:20233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388269.364150:0:20233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364156:0:20233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364295:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996a43284000) 00010000:00010000:3.0:1787388269.364297:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388269.364299:0:20233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c36 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364303:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364324:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475c28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b7 expref: 13 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364332:0:20233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6a00/0x26817551a4475c3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b7 expref: 12 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.364337:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:3.0:1787388269.364338:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787388269.364340:0:20233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6a00, rc 0) 00000100:00100000:3.0:1787388269.364431:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+12:15620:x1874211925788288:12345-192.168.203.15@tcp:101:bash.0 Request processed in 784us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388269.364436:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:0.0:1787388269.372235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388269.372383:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925788416 00000100:00100000:1.0:1787388269.372392:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925788416 00000100:00100000:1.0:1787388269.372449:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:1.0:1787388269.372459:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:15620:x1874211925788416:12345-192.168.203.15@tcp:900:bash.0 00000100:00100000:1.0:1787388269.372535:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:15620:x1874211925788416:12345-192.168.203.15@tcp:900:bash.0 Request processed in 77us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.372543:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1787388269.376283:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388269.376449:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925788672 00000100:00100000:1.0:1787388269.376458:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925788672 00000100:00100000:1.0:1787388269.376515:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:1.0:1787388269.376524:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+12:15620:x1874211925788672:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388269.376545:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388269.376563:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c44 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82be expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.376670:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.376690:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b0 expref: 12 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.376701:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.376738:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b0 expref: 12 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.376760:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b0 expref: 12 pid: 17095 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388269.376772:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa16680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874211945793664:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388269.376858:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b449a2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787388269.380656:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.380739:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925788800 00000100:00100000:3.0:1787388269.380759:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925788800 00010000:00010000:3.0:1787388269.380795:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b0 expref: 13 pid: 17095 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388269.380843:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1787388269.380852:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+13:2401:x1874211925788800:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388269.380870:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388269.380877:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b0 expref: 13 pid: 17095 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.380890:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b0 expref: 13 pid: 17095 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.380910:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:3.0:1787388269.380915:0:17081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.380925:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.380932:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.380949:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388269.380997:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+13:2401:x1874211925788800:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 146us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388269.381005:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00010000:00010000:1.0:1787388269.382442:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475c21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82b0 expref: 12 pid: 17095 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388269.382464:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa16680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874211945793664:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388269.382485:0:17095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.382495:0:17095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.382502:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.382527:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.382537:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.382548:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383029:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383050:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383057:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388269.383070:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787388269.383096:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383104:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383111:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383117:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388269.383121:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383128:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383138:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:1.0:1787388269.383141:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388269.383145:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383150:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475c4b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388269.383316:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d43f6d48 reply state 000000006e136f82 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383334:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383340:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff996b73b48900) 00010000:00010000:1.0:1787388269.383343:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388269.383412:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787388269.383447:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c44 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82be expref: 15 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383461:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82be expref: 14 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.383467:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388269.383470:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787388269.383472:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077800, rc 0) 00000100:00100000:1.0:1787388269.383524:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+15:15620:x1874211925788672:12345-192.168.203.15@tcp:101:bash.0 Request processed in 7000us (7249us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787388269.383532:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:2.0:1787388269.397779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.398204:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925788928 00000100:00100000:3.0:1787388269.398215:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925788928 00000100:00100000:3.0:1787388269.398293:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:3.0:1787388269.398303:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+15:15620:x1874211925788928:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1787388269.398327:0:20233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388269.398387:0:20233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475c67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82c5 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.398452:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c6e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.398467:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.398478:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388269.398530:0:20233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787388269.398534:0:20233:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388269.398552:0:20233:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.398563:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.398596:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475c67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82c5 expref: 17 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.398615:0:20233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82c5 expref: 16 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.398624:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:3.0:1787388269.398633:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388269.398637:0:20233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7a00, rc 0) 00000100:00100000:3.0:1787388269.398687:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+16:15620:x1874211925788928:12345-192.168.203.15@tcp:101:bash.0 Request processed in 386us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388269.398694:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:0.0:1787388269.404906:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.405105:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925789184 00000100:00100000:3.0:1787388269.405115:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925789184 00000100:00100000:3.0:1787388269.405299:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:3.0:1787388269.405310:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+16:15620:x1874211925789184:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:3.0:1787388269.405604:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+17:15620:x1874211925789184:12345-192.168.203.15@tcp:35:bash.0 Request processed in 295us (706us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787388269.405611:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00010000:00010000:1.0:1787388269.552882:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388269.556667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.558246:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925789440 00000100:00100000:3.0:1787388269.558259:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925789440 00000100:00100000:3.0:1787388269.558325:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:3.0:1787388269.558335:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+17:15630:x1874211925789440:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388269.558375:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388269.558396:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475c75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82cc expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388269.558485:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787388269.558589:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475c75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82cc expref: 19 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.558615:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48400) 00010000:00010000:3.0:1787388269.558619:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787388269.558624:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475c75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82cc expref: 19 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.558652:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f6e00, rc 0) 00000100:00100000:3.0:1787388269.559488:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+18:15630:x1874211925789440:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1147us (2823us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787388269.559497:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:0.0:1787388269.567719:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.567926:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925789696 00000100:00100000:3.0:1787388269.567936:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925789696 00000100:00100000:3.0:1787388269.568001:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:3.0:1787388269.568011:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+18:15630:x1874211925789696:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1787388269.568443:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+19:15630:x1874211925789696:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 431us (731us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787388269.568453:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:2.0:1787388269.654468:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388269.654706:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925789952 00000100:00100000:3.0:1787388269.654715:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925789952 00000100:00100000:3.0:1787388269.654841:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:3.0:1787388269.654852:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+19:15633:x1874211925789952:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1787388269.654876:0:20233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388269.654897:0:20233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475c83 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82d3 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.655006:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.655026:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.655036:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388269.655061:0:20233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787388269.656394:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475c83 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82d3 expref: 22 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.656429:0:20233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82d3 expref: 21 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388269.656437:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:3.0:1787388269.656440:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388269.656443:0:20233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7800, rc 0) 00000100:00100000:3.0:1787388269.656525:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+21:15633:x1874211925789952:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1674us (2065us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787388269.656534:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:3.0:1787388269.661638:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388269.661718:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925790080 00000100:00100000:1.0:1787388269.661736:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925790080 00000100:00100000:1.0:1787388269.661806:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:1.0:1787388269.661817:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+21:15633:x1874211925790080:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:1.0:1787388269.661879:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.661896:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.661920:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.661966:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.661975:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c98 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.661982:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.661988:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388269.661992:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.661999:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.662010:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388269.662014:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388269.662018:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c98 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.662025:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388269.662099:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+21:15633:x1874211925790080:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 284us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.662107:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:0.0:1787388269.663142:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388269.663310:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925790208 00000100:00100000:1.0:1787388269.663317:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925790208 00000100:00100000:1.0:1787388269.663389:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:1.0:1787388269.663398:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+21:2401:x1874211925790208:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388269.663410:0:18625:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388269.663428:0:18625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475c8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82d3 expref: 21 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388269.663442:0:18625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388269.663446:0:18625:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388269.663484:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+20:2401:x1874211925790208:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 85us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388269.663490:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:2.0:1787388269.668254:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388269.668379:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925790464 00000100:00100000:1.0:1787388269.668388:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925790464 00000100:00100000:1.0:1787388269.668439:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:1.0:1787388269.668449:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+20:15633:x1874211925790464:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:1.0:1787388269.668646:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+21:15633:x1874211925790464:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 198us (401us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787388269.668654:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1787388270.038576:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388270.038685:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925790720 00000100:00100000:1.0:1787388270.038695:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925790720 00000100:00100000:1.0:1787388270.038765:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:1.0:1787388270.038776:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+21:15664:x1874211925790720:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:1.0:1787388270.038807:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388270.038828:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82da expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.038943:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ca6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.038957:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.038968:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388270.038991:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787388270.039116:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475c9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82da expref: 24 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.039135:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82da expref: 23 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.039143:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388270.039146:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388270.039149:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076400, rc 0) 00000100:00100000:1.0:1787388270.039211:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+23:15664:x1874211925790720:12345-192.168.203.15@tcp:101:cat.0 Request processed in 436us (643us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787388270.039218:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00080000:2.0:1787388270.039336:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388270.042197:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388270.042280:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925790848 00000100:00100000:3.0:1787388270.042289:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925790848 00000100:00100000:3.0:1787388270.042377:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:3.0:1787388270.042387:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+23:2401:x1874211925790848:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388270.042402:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388270.042426:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475ca6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82da expref: 23 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.042443:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:3.0:1787388270.042448:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388270.042498:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+22:2401:x1874211925790848:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 113us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388270.042519:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:2.0:1787388270.044341:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388270.044435:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925791104 00000100:00100000:1.0:1787388270.044443:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925791104 00000100:00100000:1.0:1787388270.044489:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:1.0:1787388270.044498:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+22:15664:x1874211925791104:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:1.0:1787388270.044771:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+23:15664:x1874211925791104:12345-192.168.203.15@tcp:35:cat.0 Request processed in 273us (436us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787388270.044791:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:0.0:1787388270.156270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388270.156389:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925791360 00000100:00100000:1.0:1787388270.156400:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925791360 00000100:00100000:1.0:1787388270.156457:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:1.0:1787388270.156467:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+23:15670:x1874211925791360:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:1.0:1787388270.156490:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388270.156509:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475cb4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82e1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.156624:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475cbb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.156637:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475cbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.156648:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475cbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388270.156659:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787388270.156775:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475cb4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e1 expref: 26 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.156802:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475cbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e1 expref: 25 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.156812:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388270.156815:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388270.156818:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077c00, rc 0) 00000100:00100000:1.0:1787388270.156888:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+25:15670:x1874211925791360:12345-192.168.203.15@tcp:101:dd.0 Request processed in 422us (627us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787388270.156896:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:0.0:1787388270.161753:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388270.161804:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388270.161864:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925791616 00000100:00100000:1.0:1787388270.161869:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925791488 00000100:00100000:1.0:1787388270.161874:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925791488 00000100:00100000:2.0:1787388270.161881:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925791616 00000100:00100000:1.0:1787388270.161931:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:1.0:1787388270.161941:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+25:15670:x1874211925791488:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:1.0:1787388270.161974:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787388270.161990:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00010000:00010000:1.0:1787388270.161994:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cc9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82e8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388270.161997:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+26:2401:x1874211925791616:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388270.162028:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.162040:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.162051:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.162074:0:18625:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388270.162091:0:18625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475cbb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e1 expref: 27 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.162107:0:18625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:2.0:1787388270.162112:0:18625:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388270.162168:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e8 expref: 27 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.162183:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e8 expref: 26 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.162190:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388270.162192:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388270.162194:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076400, rc 0) 00000100:00100000:2.0:1787388270.162504:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+26:2401:x1874211925791616:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 506us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388270.162512:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:1.0:1787388270.164875:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+25:15670:x1874211925791488:12345-192.168.203.15@tcp:101:dd.0 Request processed in 2925us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388270.164886:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:0.0:1787388270.177409:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388270.177476:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925791872 00000100:00100000:1.0:1787388270.177486:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925791872 00000100:00100000:1.0:1787388270.177614:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:1.0:1787388270.177625:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+25:15670:x1874211925791872:12345-192.168.203.15@tcp:36:dd.0 00010000:00010000:1.0:1787388270.177678:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388270.177708:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475c6e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82c5 expref: 25 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.177725:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388270.177729:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787388270.177908:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.177921:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.177930:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388270.177968:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787388270.177989:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb338f15 reply state 000000004dd01bda transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.178001:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388270.178007:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388270.178017:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388270.178019:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388270.178111:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+27:15670:x1874211925791872:12345-192.168.203.15@tcp:36:dd.0 Request processed in 487us (711us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787388270.178118:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00000020:00080000:1.0:1787388270.178123:0:17095:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787388270.285693:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388270.285814:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925792128 00000100:00100000:3.0:1787388270.285823:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925792128 00000100:00100000:3.0:1787388270.285881:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:3.0:1787388270.285891:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+27:15670:x1874211925792128:12345-192.168.203.15@tcp:35:dd.0 00000100:00100000:3.0:1787388270.286120:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+28:15670:x1874211925792128:12345-192.168.203.15@tcp:35:dd.0 Request processed in 230us (435us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1787388270.286129:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00010000:00010000:0.0:1787388270.572510:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787388270.605923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388270.606044:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925792256 00000100:00100000:3.0:1787388270.606054:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925792256 00000100:00100000:3.0:1787388270.606165:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:3.0:1787388270.606176:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+28:15685:x1874211925792256:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:3.0:1787388270.606200:0:20233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388270.606221:0:20233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cde lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82ef expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606288:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475ce5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606302:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606314:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606325:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475cec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606383:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475cec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606392:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475cec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606463:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475cf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606472:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606478:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388270.606518:0:20233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787388270.606523:0:20233:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388270.606560:0:20233:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606571:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606579:0:20233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606584:0:20233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475ce5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606589:0:20233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606603:0:20233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388270.606608:0:20233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606615:0:20233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475ce5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606626:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:3.0:1787388270.606630:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388270.606634:0:20233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475ce5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606639:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475ce5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606652:0:20233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475cec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606657:0:20233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475cec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606662:0:20233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475cec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606667:0:20233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388270.606670:0:20233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475cec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606675:0:20233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475cec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606693:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff996b73b48900) 00010000:00010000:3.0:1787388270.606696:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388270.606699:0:20233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475cec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606705:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475cec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606730:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cde lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82ef expref: 30 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606742:0:20233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82ef expref: 29 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.606748:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:3.0:1787388270.606751:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787388270.606753:0:20233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7a00, rc 0) 00000100:00100000:3.0:1787388270.606823:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+29:15685:x1874211925792256:12345-192.168.203.15@tcp:101:stat.0 Request processed in 649us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388270.606830:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:0.0:1787388270.703822:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388270.703958:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925792512 00000100:00100000:3.0:1787388270.703982:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925792512 00000100:00100000:3.0:1787388270.704045:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:3.0:1787388270.704055:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7f5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+29:15691:x1874211925792512:12345-192.168.203.15@tcp:36:truncate.0 00010000:00010000:3.0:1787388270.704112:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388270.704138:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475cf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82ef expref: 29 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.704177:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:3.0:1787388270.704182:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787388270.704714:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.704729:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.704739:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787388270.704782:0:17096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1787388270.704816:0:17096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097cb59eb reply state 00000000b572a25a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.704828:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388270.704833:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:3.0:1787388270.704836:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787388270.704839:0:17096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787388270.705149:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7f5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+31:15691:x1874211925792512:12345-192.168.203.15@tcp:36:truncate.0 Request processed in 1092us (1332us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787388270.705157:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000020:00080000:3.0:1787388270.705162:0:17096:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787388270.957208:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388270.958155:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925792640 00000100:00100000:2.0:1787388270.958166:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925792640 00000100:00100000:2.0:1787388270.958230:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:2.0:1787388270.958240:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+31:15705:x1874211925792640:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:2.0:1787388270.958275:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388270.958295:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a4475d01 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82f6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.958466:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475d08 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.958481:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475d08 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.959086:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475d08 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.959101:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475d0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.959110:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475d0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.959117:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475d0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.959185:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.959194:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.959201:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388270.959244:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1787388270.959259:0:17094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787388270.959281:0:17094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.959293:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.959301:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475d08 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.960615:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475d08 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.960628:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475d08 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.961411:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5e00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388270.961422:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475d08 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.961433:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475d08 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.961451:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:2.0:1787388270.961454:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388270.961458:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475d08 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.961464:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475d08 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.961482:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475d0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.962060:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475d0f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.962066:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475d0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.962072:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388270.962076:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475d0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.962082:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475d0f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.962093:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff996b73b48900) 00010000:00010000:2.0:1787388270.962096:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388270.962099:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475d0f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.962105:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475d0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.962156:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a4475d01 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82f6 expref: 33 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.962170:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82f6 expref: 32 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388270.962177:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:2.0:1787388270.962180:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787388270.962188:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4800, rc 0) 00000100:00100000:2.0:1787388270.962271:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+32:15705:x1874211925792640:12345-192.168.203.15@tcp:101:stat.0 Request processed in 4031us (5072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388270.962280:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:0.0:1787388271.087441:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388271.087543:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925792896 00000100:00100000:1.0:1787388271.087554:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925792896 00000100:00100000:1.0:1787388271.087620:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:1.0:1787388271.087631:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+32:15715:x1874211925792896:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1787388271.087652:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388271.087673:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe82fd expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388271.087784:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787388271.087894:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82fd expref: 34 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.087908:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48400) 00010000:00010000:1.0:1787388271.087912:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388271.087916:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82fd expref: 34 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.087929:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70076a00, rc 0) 00000100:00100000:1.0:1787388271.087991:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+33:15715:x1874211925792896:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 362us (559us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1787388271.087999:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:0.0:1787388271.094235:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388271.094396:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925793152 00000100:00100000:1.0:1787388271.094420:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925793152 00000100:00100000:1.0:1787388271.094473:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:1.0:1787388271.094484:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7d73e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+33:15715:x1874211925793152:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:1.0:1787388271.094757:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7d73e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+34:15715:x1874211925793152:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 274us (529us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787388271.094765:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:0.0:1787388271.217497:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388271.217664:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925793408 00000100:00100000:3.0:1787388271.217675:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925793408 00000100:00100000:3.0:1787388271.217743:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:3.0:1787388271.217753:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+34:15721:x1874211925793408:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1787388271.217810:0:20233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388271.217831:0:20233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d2b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8304 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.217937:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.217957:0:20233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82be expref: 35 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.217966:0:20233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82f6 expref: 35 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.217974:0:20233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.218006:0:20233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82f6 expref: 35 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.218017:0:20233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82f6 expref: 35 pid: 17094 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388271.218030:0:20233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20233:1874211945793792:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388271.218112:0:20233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82be expref: 35 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.218121:0:20233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82be expref: 35 pid: 17095 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388271.218141:0:20233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20233:1874211945793920:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388271.218163:0:20233:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b41254780 going to sleep for 11 seconds 00000100:00100000:3.0:1787388271.228259:0:20233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20233:1874211945793792:192.168.203.15@tcp:104: 00000100:00100000:0.0:1787388271.228491:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388271.228696:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925793536 00000100:00100000:3.0:1787388271.228701:0:20233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20233:1874211945793920:192.168.203.15@tcp:104: 00000100:00100000:2.0:1787388271.228703:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925793536 00010000:00010000:3.0:1787388271.228725:0:20233:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.228738:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82f6 expref: 36 pid: 17094 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388271.228802:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:2.0:1787388271.228812:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+36:2401:x1874211925793536:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388271.228825:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388271.228832:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82f6 expref: 36 pid: 17094 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.228844:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82f6 expref: 36 pid: 17094 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.228865:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d16 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82f6 expref: 36 pid: 17094 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.228891:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:2.0:1787388271.228897:0:17081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.228906:0:17081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.228912:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388271.228977:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+35:2401:x1874211925793536:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 165us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.228985:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1787388271.235320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388271.235698:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925793664 00000100:00100000:1.0:1787388271.235709:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925793664 00010000:00010000:1.0:1787388271.235754:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82be expref: 35 pid: 17095 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388271.235898:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:1.0:1787388271.235908:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+35:2402:x1874211925793664:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787388271.235923:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787388271.235929:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82be expref: 35 pid: 17095 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.235943:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82be expref: 35 pid: 17095 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.235963:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475c59 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82be expref: 35 pid: 17095 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.235978:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388271.235983:0:17080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.236012:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.236029:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.236065:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787388271.236120:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+34:2402:x1874211925793664:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 213us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388271.236127:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00010000:00010000:3.0:1787388271.236186:0:20233:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.236194:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388271.236212:0:20233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787388271.236341:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d2b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8304 expref: 35 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.236379:0:20233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8304 expref: 34 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.236398:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:3.0:1787388271.236401:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787388271.236404:0:20233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7400, rc 0) 00000100:00100000:3.0:1787388271.236430:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+34:15721:x1874211925793408:12345-192.168.203.15@tcp:101:bash.0 Request processed in 18679us (18943us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1787388271.236437:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:0.0:1787388271.239603:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388271.239744:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925793920 00000100:00100000:1.0:1787388271.239754:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925793920 00000100:00100000:1.0:1787388271.239825:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:1.0:1787388271.239836:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+34:15721:x1874211925793920:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:1.0:1787388271.240096:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.240115:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.240126:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388271.240172:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1787388271.240193:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000602061a7 reply state 000000008d4b937f transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.240206:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.240226:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388271.240228:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787388271.240232:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787388271.243123:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+37:15721:x1874211925793920:12345-192.168.203.15@tcp:36:bash.0 Request processed in 3277us (3518us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1787388271.243136:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000020:00080000:1.0:1787388271.243143:0:17095:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787388271.258904:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388271.260384:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925794048 00000100:00100000:2.0:1787388271.260407:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925794048 00000100:00100000:2.0:1787388271.260669:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:2.0:1787388271.260680:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+37:15721:x1874211925794048:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388271.260704:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388271.260725:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe830b expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.260780:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe830b expref: 38 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.260805:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe830b expref: 38 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.260824:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:2.0:1787388271.260827:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787388271.260831:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e4800, rc 0) 00000100:00100000:2.0:1787388271.260907:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+38:15721:x1874211925794048:12345-192.168.203.15@tcp:101:bash.0 Request processed in 229us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.260914:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:0.0:1787388271.268800:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388271.268881:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925794176 00000100:00100000:3.0:1787388271.268891:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925794176 00000100:00100000:3.0:1787388271.268953:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:3.0:1787388271.268962:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4223ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+38:15721:x1874211925794176:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1787388271.268997:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388271.269018:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d4e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8312 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.269124:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.269139:0:17096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8304 expref: 39 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.269149:0:17096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.269181:0:17096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8304 expref: 39 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.269195:0:17096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8304 expref: 39 pid: 20233 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388271.269209:0:17096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17096:1874211945794048:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388271.269287:0:17096:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b41254780 going to sleep for 11 seconds 00000100:00100000:3.0:1787388271.273163:0:17096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17096:1874211945794048:192.168.203.15@tcp:104: 00010000:00010000:3.0:1787388271.273190:0:17096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388271.274724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388271.275101:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925794304 00000100:00100000:2.0:1787388271.275111:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925794304 00010000:00010000:2.0:1787388271.275148:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8304 expref: 40 pid: 20233 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388271.275211:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:2.0:1787388271.275219:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+40:2401:x1874211925794304:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388271.275234:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388271.275240:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8304 expref: 40 pid: 20233 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.275253:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8304 expref: 40 pid: 20233 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.275275:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d32 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8304 expref: 40 pid: 20233 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.275290:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:2.0:1787388271.275295:0:17081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.275304:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.275312:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.275341:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388271.275430:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+39:2401:x1874211925794304:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 211us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.275439:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00010000:00010000:0.0:1787388271.275555:0:17096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388271.275573:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787388271.275629:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787388271.275633:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787388271.275654:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388271.275682:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d4e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8312 expref: 39 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388271.275696:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8312 expref: 38 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388271.275716:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:0.0:1787388271.275719:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787388271.275722:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7000, rc 0) 00000100:00100000:0.0:1787388271.275745:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4223ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+38:15721:x1874211925794176:12345-192.168.203.15@tcp:101:bash.0 Request processed in 6785us (6966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388271.275752:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:0.0:1787388271.279660:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388271.279745:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925794560 00000100:00100000:2.0:1787388271.279767:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925794560 00000100:00100000:2.0:1787388271.279838:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:2.0:1787388271.279848:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+38:15721:x1874211925794560:12345-192.168.203.15@tcp:103:bash.0 00010000:00010000:2.0:1787388271.279866:0:18625:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787388271.279895:0:18625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4800/0x26817551a4475d47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe830b expref: 38 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.279916:0:18625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8312 expref: 37 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388271.279927:0:18625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:2.0:1787388271.279932:0:18625:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388271.279998:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+36:15721:x1874211925794560:12345-192.168.203.15@tcp:103:bash.0 Request processed in 151us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388271.280006:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:0.0:1787388271.282828:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388271.282909:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925794688 00000100:00100000:3.0:1787388271.282918:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925794688 00000100:00100000:3.0:1787388271.282976:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:3.0:1787388271.282986:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+36:15721:x1874211925794688:12345-192.168.203.15@tcp:58:bash.0 00010000:00010000:3.0:1787388271.283110:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.283127:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388271.283139:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787388271.284310:0:20233:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787388271.284730:0:20233:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787388271.284862:0:20233:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787388271.285005:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+36:15721:x1874211925794688:12345-192.168.203.15@tcp:58:bash.0 Request processed in 2016us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388271.285015:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:0.0:1787388271.287753:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388271.287868:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925794816 00000100:00100000:1.0:1787388271.287877:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925794816 00000100:00100000:1.0:1787388271.287971:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:1.0:1787388271.287980:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+36:15721:x1874211925794816:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1787388271.287999:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388271.288019:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475d63 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8319 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.288069:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.288080:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475d63 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8319 expref: 37 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.288096:0:17095:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.288109:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475d63 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8319 expref: 37 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.288121:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388271.288136:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388271.288140:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475d63 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8319 expref: 37 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388271.288148:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077800, rc 0) 00000100:00100000:1.0:1787388271.288251:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+37:15721:x1874211925794816:12345-192.168.203.15@tcp:101:bash.0 Request processed in 272us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388271.288258:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:0.0:1787388271.342739:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945794176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787388271.342820:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787388271.342968:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945794176 00000100:00100000:3.0:1787388271.342976:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945794176 00000100:00100000:3.0:1787388271.343042:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787388271.343052:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945794176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787388271.343080:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787388271.343127:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945794176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388271.343134:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787388271.343189:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945794176:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787388271.343293:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787388271.597175:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787388272.242687:0:17130:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787388272.242697:0:17130:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388272.242723:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787388272.242731:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787388272.242872:0:17130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17130:1874211945794304:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787388272.242952:0:17130:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b41254e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787388272.254173:0:17130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17130:1874211945794304:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787388272.254462:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.254832:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925794944 00000100:00100000:1.0:1787388272.254839:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925794944 00000100:00100000:1.0:1787388272.254905:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:1.0:1787388272.254915:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+37:15722:x1874211925794944:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787388272.254965:0:17094:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787388272.255087:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+37:15722:x1874211925794944:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 173us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.255095:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00080000:0.0:1787388272.255630:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787388272.264464:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388272.265451:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925795072 00000100:00100000:3.0:1787388272.265463:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925795072 00000100:00100000:3.0:1787388272.265527:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:3.0:1787388272.265537:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+37:15722:x1874211925795072:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787388272.266021:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d6a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.266040:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.266052:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.266096:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d71 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.266453:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.266463:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.266502:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.266511:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.266518:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787388272.266561:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787388272.266565:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787388272.266578:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267476:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267487:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d6a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267494:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d6a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267500:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388272.267503:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d6a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267510:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d6a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267524:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b4a814900) 00010000:00010000:3.0:1787388272.267537:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388272.267542:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267549:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7000/0x26817551a4475d6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267946:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267953:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d71 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267960:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267965:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388272.267968:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267974:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d71 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267983:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff996a43284a00) 00010000:00010000:3.0:1787388272.267986:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388272.267989:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d71 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.267994:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475d71 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.268011:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.268024:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.268029:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.268035:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:3.0:1787388272.268038:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.268043:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.268051:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:3.0:1787388272.268053:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787388272.268056:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.268062:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475d78 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388272.270488:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+37:15722:x1874211925795072:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 4941us (6021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.270502:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:2.0:1787388272.275143:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.275409:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925795328 00000100:00100000:1.0:1787388272.275419:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925795328 00000100:00100000:1.0:1787388272.275489:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:1.0:1787388272.275499:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+37:15722:x1874211925795328:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388272.275519:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388272.275539:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475d7f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8320 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.275641:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d86 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.275656:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.275680:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388272.275692:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787388272.275790:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.275797:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d86 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.275804:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.275810:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077c00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388272.275815:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.275822:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d86 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.275835:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388272.275838:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787388272.275842:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d86 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.275848:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d86 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.276069:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475d7f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8320 expref: 39 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.276089:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996b4a814900) 00010000:00010000:1.0:1787388272.276092:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787388272.276095:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475d7f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8320 expref: 39 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.276113:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077e00, rc 0) 00000100:00100000:1.0:1787388272.276165:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+38:15722:x1874211925795328:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 669us (1031us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1787388272.276172:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:0.0:1787388272.283962:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.286101:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925795456 00000100:00100000:1.0:1787388272.286116:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925795456 00000100:00100000:1.0:1787388272.286186:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:1.0:1787388272.286197:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+38:15722:x1874211925795456:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787388272.286232:0:17095:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787388272.286622:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+38:15722:x1874211925795456:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 149us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.286632:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:0.0:1787388272.292897:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.293207:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925795712 00000100:00100000:1.0:1787388272.293217:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925795712 00000100:00100000:1.0:1787388272.293280:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:1.0:1787388272.293289:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+38:15722:x1874211925795712:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388272.293309:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388272.293329:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475d94 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8327 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787388272.293726:0:17094:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:1.0:1787388272.293733:0:17094:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1787388272.293753:0:17094:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787388272.293905:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.293919:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.293930:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.294415:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475d94 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8327 expref: 41 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.294434:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8327 expref: 40 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.294443:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996b73b48a00) 00010000:00010000:1.0:1787388272.294446:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787388272.294449:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077c00, rc 0) 00000100:00100000:1.0:1787388272.294562:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+40:15722:x1874211925795712:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1264us (1664us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787388272.294570:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:0.0:1787388272.320276:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388272.320370:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925795968 00000100:00100000:2.0:1787388272.320380:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925795968 00000100:00100000:2.0:1787388272.320442:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1787388272.320452:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+40:15722:x1874211925795968:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388272.320508:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388272.320534:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475d9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8327 expref: 40 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320566:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996b73b48a00) 00010000:00010000:2.0:1787388272.320577:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388272.320600:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475da9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320614:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475da9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320623:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475da9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320656:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475db0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x99779d0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320663:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475db0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x99779d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320670:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475db0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x99779d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320711:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475da9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320717:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475da9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320723:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475da9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320729:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388272.320733:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475da9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320748:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475da9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320756:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:2.0:1787388272.320759:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388272.320763:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475da9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320769:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5600/0x26817551a4475da9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320778:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475db0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x99779d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320794:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475db0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x99779d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320800:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475db0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x99779d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320806:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5e00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388272.320809:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475db0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x99779d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320815:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475db0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x99779d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320822:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x99779d0b (ffff996b4a814f00) 00010000:00010000:2.0:1787388272.320825:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388272.320827:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475db0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x99779d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.320844:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475db0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x99779d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388272.320925:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+39:15722:x1874211925795968:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 474us (659us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787388272.320932:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:0.0:1787388272.328546:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388272.329564:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925796096 00000100:00100000:3.0:1787388272.329576:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925796096 00000100:00100000:3.0:1787388272.329686:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:3.0:1787388272.329697:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+39:15722:x1874211925796096:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388272.329717:0:20233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388272.329739:0:20233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475db7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe832e expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.329772:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475dbe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.329806:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475dbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.329817:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475dbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.329923:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7400/0x26817551a4475db7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe832e expref: 41 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.330041:0:20233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7a00/0x26817551a4475dbe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe832e expref: 40 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.330050:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996a43284a00) 00010000:00010000:3.0:1787388272.330053:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787388272.330057:0:20233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7a00, rc 0) 00000100:00100000:3.0:1787388272.330158:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+40:15722:x1874211925796096:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 463us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.330166:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:0.0:1787388272.344156:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388272.344253:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925796352 00000100:00100000:2.0:1787388272.344263:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925796352 00000100:00100000:2.0:1787388272.344324:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:2.0:1787388272.344334:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+40:15722:x1874211925796352:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388272.344438:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.344455:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.344466:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787388272.344635:0:17096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787388272.344645:0:17096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 593867297506ns, next at 594867295599ns, rc = 0 00000004:00010000:2.0:1787388272.344691:0:17096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000658e7618 reply state 00000000c93ab41e transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.344704:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.344712:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996a43284a00) 00010000:00010000:2.0:1787388272.344728:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787388272.344732:0:17096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388272.344837:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+42:15722:x1874211925796352:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 503us (689us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1787388272.344844:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:0.0:1787388272.353402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.354068:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925796480 00000100:00100000:1.0:1787388272.354079:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925796480 00000100:00100000:1.0:1787388272.354143:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:1.0:1787388272.354153:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+42:15722:x1874211925796480:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388272.354191:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388272.354212:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475dcc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8335 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.354269:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475dcc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8335 expref: 43 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.354284:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475dcc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8335 expref: 43 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.354302:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996a43284a00) 00010000:00010000:1.0:1787388272.354306:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388272.354309:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b70077e00, rc 0) 00000100:00100000:1.0:1787388272.354401:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+43:15722:x1874211925796480:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 248us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.354409:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:0.0:1787388272.363055:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388272.363179:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925796608 00000100:00100000:3.0:1787388272.363188:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925796608 00000100:00100000:3.0:1787388272.363255:0:19466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1787388272.363264:0:19466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2402:x1874211925796608:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787388272.363496:0:19466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2402:x1874211925796608:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 233us (449us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787388272.363504:0:19466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00080000:0.0:1787388272.364063:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787388272.365306:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787388272.365324:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945794432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787388272.365407:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388272.365581:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945794944:0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.365611:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388272.365627:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945795456:0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.365647:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388272.365662:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945795968:0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.365682:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388272.365698:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787388272.365704:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945794816:0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.365726:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388272.365743:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945795328:0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.365795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388272.365810:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945795840:0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.365829:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388272.365854:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945794816 00000100:00100000:1.0:1787388272.365861:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945794816 00000100:00100000:1.0:1787388272.365906:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945795328 00000100:00100000:1.0:1787388272.365910:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945795328 00000100:00100000:1.0:1787388272.365929:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787388272.366112:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945794816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.366169:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874211945794816:12345-0@lo:400:kworker.0 Request processed in 60us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.366176:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787388272.366191:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787388272.366196:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b4831dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945795328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.366219:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b4831dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945795328:12345-0@lo:400:kworker.0 Request processed in 23us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.366224:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787388272.366367:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388272.366371:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787388272.366389:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945794944 00000100:00100000:1.0:1787388272.366393:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945794944 00000100:00100000:1.0:1787388272.366409:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945795456 00000100:00100000:1.0:1787388272.366411:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945795456 00000100:00100000:1.0:1787388272.366419:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945795968 00000100:00100000:1.0:1787388272.366421:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945795968 00000100:00080000:1.0:1787388272.366432:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388272.366441:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945795840 00000100:00100000:1.0:1787388272.366443:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945795840 00000100:00080000:1.0:1787388272.366451:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787388272.366470:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787388272.366476:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945794944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.366502:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874211945794944:12345-0@lo:400:kworker.0 Request processed in 26us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.366507:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787388272.366516:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787388272.366521:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945795456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.366539:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874211945795456:12345-0@lo:400:kworker.0 Request processed in 17us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.366544:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787388272.366551:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787388272.366556:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945795968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.366576:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874211945795968:12345-0@lo:400:kworker.0 Request processed in 20us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.366581:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787388272.366592:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787388272.366597:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945795840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787388272.366619:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a4337bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874211945795840:12345-0@lo:400:kworker.0 Request processed in 23us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.366624:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787388272.366703:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1874211945794816:0@lo:400:kworker.0 00000100:00100000:0.0:1787388272.366723:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945795328:0@lo:400:kworker.0 00000100:00100000:0.0:1787388272.366731:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1874211945795840:0@lo:400:kworker.0 00000100:00100000:0.0:1787388272.366739:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874211945794944:0@lo:400:kworker.0 00000100:00100000:0.0:1787388272.366747:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874211945795456:0@lo:400:kworker.0 00010000:00080000:0.0:1787388272.366758:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7aa15180 x1874211945795968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388272.366768:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1874211945795968:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367091:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945794688:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367125:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388272.367146:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945795200:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388272.367182:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945795712:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367205:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388272.367215:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945796224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388272.367231:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388272.367244:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787388272.367251:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945794560:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367274:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388272.367297:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945795072:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367316:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388272.367326:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945795584:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388272.367373:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945796096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787388272.367393:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388272.367417:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945795200 00000100:00100000:2.0:1787388272.367421:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945795200 00000100:00100000:2.0:1787388272.367444:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787388272.367450:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945795200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367487:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945795200:12345-0@lo:400:kworker.0 Request processed in 37us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.367493:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787388272.367510:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945794688 00000100:00100000:2.0:1787388272.367513:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945794688 00000100:00100000:2.0:1787388272.367526:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945796224 00000100:00100000:2.0:1787388272.367528:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945796224 00000100:00100000:2.0:1787388272.367535:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945795072 00000100:00100000:2.0:1787388272.367537:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945795072 00000100:00100000:2.0:1787388272.367546:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787388272.367551:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874211945794688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367579:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874211945794688:12345-0@lo:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.367584:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787388272.367595:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787388272.367600:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945796224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787388272.367621:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787388272.367646:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945796224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.367651:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787388272.367662:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388272.367667:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945795072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367693:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874211945795072:12345-0@lo:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.367699:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787388272.367714:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945794560 00000100:00100000:2.0:1787388272.367717:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945794560 00000100:00100000:2.0:1787388272.367746:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787388272.367752:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3650:x1874211945794560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367791:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae525cec-d184-4a5a-bf65-8c20a2a658d5+24:3650:x1874211945794560:12345-0@lo:400:kworker.0 Request processed in 28us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.367798:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787388272.367831:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae525cec-d184-4a5a-bf65-8c20a2a658d5:3650:1874211945794560:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367842:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945795072:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367850:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945794688:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367858:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1874211945795200:0@lo:400:kworker.0 00000100:00100000:2.0:1787388272.367869:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945796224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787388272.367893:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945795712 00000100:00100000:2.0:1787388272.367896:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945795712 00000100:00100000:2.0:1787388272.367917:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945795584 00000100:00100000:2.0:1787388272.367920:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945795584 00000100:00100000:2.0:1787388272.367933:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787388272.367939:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945795712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787388272.368072:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787388272.368081:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945796352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787388272.368105:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388272.368127:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945796352 00000100:00100000:0.0:1787388272.368131:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945796352 00000100:00100000:0.0:1787388272.368148:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787388272.368154:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945796352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787388272.368172:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787388272.368202:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874211945796352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388272.368208:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787388272.368231:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1874211945796352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787388272.369058:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945794432 00000100:00100000:3.0:1787388272.369071:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945794432 00000100:00100000:3.0:1787388272.369096:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945796096 00000100:00100000:3.0:1787388272.369098:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945796096 00000100:00100000:3.0:1787388272.369110:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787388272.369116:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945794432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787388272.369136:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787388272.369176:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874211945794432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (3769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.369183:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787388272.369193:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787388272.369198:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945796096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787388272.369207:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787388272.369247:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874211945796096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.369253:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787388272.369280:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787388272.369287:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945795584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787388272.369316:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874211945795584:12345-0@lo:400:kworker.0 Request processed in 31us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.369322:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787388272.369520:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388272.369526:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787388272.369528:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787388272.369558:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1874211945794432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787388272.369572:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787388272.369578:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945796480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787388272.369615:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787388272.369725:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874211945795712:12345-0@lo:400:kworker.0 Request processed in 1785us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.369733:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787388272.369838:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1874211945795584:0@lo:400:kworker.0 00000100:00100000:0.0:1787388272.369854:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1874211945796096:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787388272.369866:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff996b7aa16a00 x1874211945795712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787388288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787388272.369883:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1874211945795712:0@lo:400:kworker.0 00000100:00100000:3.0:1787388272.370256:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945796480 00000100:00100000:3.0:1787388272.370261:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945796480 00000100:00100000:3.0:1787388272.370288:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787388272.370295:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945796480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787388272.370309:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787388272.370383:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874211945796480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.370399:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787388272.370480:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1874211945796480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787388272.371674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.371858:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925796864 00000100:00100000:1.0:1787388272.371866:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925796864 00000100:00100000:1.0:1787388272.371911:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:1.0:1787388272.371920:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+43:15722:x1874211925796864:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787388272.372639:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+44:15722:x1874211925796864:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 718us (967us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787388272.372647:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:2.0:1787388272.375447:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388272.375672:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925797120 00000100:00100000:3.0:1787388272.375681:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925797120 00000100:00100000:3.0:1787388272.375778:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:3.0:1787388272.375798:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+44:15722:x1874211925797120:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787388272.375906:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+44:15722:x1874211925797120:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 110us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.375914:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:0.0:1787388272.378861:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.379072:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925797248 00000100:00100000:1.0:1787388272.379082:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925797248 00000100:00100000:1.0:1787388272.379461:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:1.0:1787388272.379472:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+44:15722:x1874211925797248:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787388272.379492:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787388272.379513:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475dd3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe833c expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.379612:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838fe00/0x26817551a4475dda lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.379627:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838fe00/0x26817551a4475dda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.379637:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838fe00/0x26817551a4475dda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787388272.379682:0:17094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787388272.379701:0:17094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838fe00/0x26817551a4475dda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.379741:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077c00/0x26817551a4475dd3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe833c expref: 46 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.379760:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838fe00/0x26817551a4475dda lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe833c expref: 45 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.379768:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996a43284a00) 00010000:00010000:1.0:1787388272.379771:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787388272.379775:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b4838fe00, rc 0) 00000100:00100000:1.0:1787388272.379840:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+45:15722:x1874211925797248:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 370us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.379848:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:0.0:1787388272.383881:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388272.384295:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925797376 00000100:00100000:3.0:1787388272.384305:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925797376 00000100:00100000:3.0:1787388272.384377:0:19466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1787388272.384387:0:19466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+6:2401:x1874211925797376:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388272.384405:0:19466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388272.384424:0:19466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7ec959/0x26817551a4475de1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8343 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787388272.384449:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a896170, blocks: 0x0 00010000:00010000:3.0:1787388272.384467:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=593s v=(0 0) 00010000:00010000:3.0:1787388272.384471:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388272.384480:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7ec959/0x26817551a4475de1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8343 expref: 7 pid: 19466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.384498:0:19466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c7ec959/0x26817551a4475de1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8343 expref: 7 pid: 19466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.384531:0:19466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7400, rc 0) 00000100:00100000:3.0:1787388272.384588:0:19466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:2401:x1874211925797376:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 203us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.384596:0:19466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1787388272.388150:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.388241:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925797632 00000100:00100000:1.0:1787388272.388252:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925797632 00000100:00100000:1.0:1787388272.388313:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:1.0:1787388272.388324:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+45:15722:x1874211925797632:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787388272.388451:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+45:15722:x1874211925797632:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 130us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.388459:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:0.0:1787388272.390929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388272.391039:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925797760 00000100:00100000:2.0:1787388272.391048:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925797760 00000100:00100000:2.0:1787388272.391102:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:2.0:1787388272.391112:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+45:15722:x1874211925797760:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787388272.394054:0:17075:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1787388272.394070:0:17075:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787388272.394164:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394176:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394184:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394190:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388272.394194:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394202:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394220:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996a43284000) 00010000:00010000:2.0:1787388272.394223:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388272.394227:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394233:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6600/0x26817551a4475ba3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394252:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394258:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394263:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394278:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e4c00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388272.394281:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394289:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394297:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:2.0:1787388272.394299:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388272.394302:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394306:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4c00/0x26817551a4475baa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394320:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394325:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394330:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394335:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70077600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388272.394337:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394342:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394393:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff996b73b48900) 00010000:00010000:2.0:1787388272.394395:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388272.394398:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394403:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077600/0x26817551a4475c52 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394419:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394425:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394430:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394435:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076600 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388272.394438:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394443:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394449:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:2.0:1787388272.394451:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388272.394453:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394458:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076600/0x26817551a4475cd7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394478:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394484:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394490:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394494:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f6e00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388272.394497:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394502:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394509:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:2.0:1787388272.394511:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388272.394514:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394520:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f6e00/0x26817551a4475cfa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394529:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394534:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394540:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394549:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b70076a00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388272.394552:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394569:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394576:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:2.0:1787388272.394578:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787388272.394581:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394586:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076a00/0x26817551a4475d40 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394596:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394601:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394607:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394611:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5e00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388272.394613:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394619:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394633:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996a43284a00) 00010000:00010000:2.0:1787388272.394635:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787388272.394638:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.394643:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5e00/0x26817551a4475dc5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388272.395218:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7aa14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945796608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787388272.395286:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787388272.396967:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945796608 00000100:00100000:0.0:1787388272.396978:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945796608 00000100:00100000:0.0:1787388272.397048:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787388272.397058:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874211945796608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787388272.397194:0:19184:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787388272.397198:0:19184:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787388272.397200:0:19184:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787388272.397202:0:19184:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787388272 -> 1787388272 00002000:00010000:0.0:1787388272.397204:0:19184:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787388272.397268:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1874211945796608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 211us (1981us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787388272.397275:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1787388272.397499:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996b7aa14380/2, rc 0, transno 8589934596 00000100:00100000:3.0:1787388272.397506:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7aa14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1874211945796608:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1787388272.398934:0:17075:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1787388272.399191:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+14:15722:x1874211925797760:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 8075us (8266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.399201:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00010000:00010000:2.0:1787388272.400415:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.400430:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.400439:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.400445:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b74e09000 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:2.0:1787388272.400450:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.400458:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.400473:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:2.0:1787388272.400476:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787388272.400481:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.400488:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09000/0x26817551a4475bf7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787388272.403269:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.404290:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925797888 00000100:00100000:1.0:1787388272.404301:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925797888 00000100:00100000:1.0:1787388272.404501:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:1.0:1787388272.404512:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:2402:x1874211925797888:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787388272.404659:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:2402:x1874211925797888:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 148us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.404666:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:1.0:1787388272.408405:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388272.408576:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925798144 00000100:00100000:2.0:1787388272.408585:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925798144 00000100:00100000:2.0:1787388272.408638:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:2.0:1787388272.408647:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+14:15722:x1874211925798144:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787388272.408710:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388272.408734:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838fe00/0x26817551a4475dda lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe833c expref: 14 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.408752:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996a43284a00) 00010000:00010000:2.0:1787388272.408756:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787388272.408801:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a4475de8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.408813:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a4475de8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.408822:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a4475de8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787388272.408935:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc33b70d reply state 000000004c5710b2 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a4475de8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.408948:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e4200/0x26817551a4475de8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.408965:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996a43284a00) 00010000:00010000:2.0:1787388272.408968:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787388272.408971:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787388272.409703:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+15:15722:x1874211925798144:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 1054us (1303us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787388272.409722:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:0.0:1787388272.414645:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388272.414735:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925798272 00000100:00100000:3.0:1787388272.414745:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925798272 00000100:00100000:3.0:1787388272.414915:0:19466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:3.0:1787388272.414924:0:19466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:15722:x1874211925798272:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787388272.414941:0:19466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787388272.414967:0:19466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe834a expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.414998:0:19466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c7ec959/0x26817551a4475de1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8343 expref: 8 pid: 19466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.415007:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388272.415022:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787388272.415027:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 8 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.415059:0:19466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c7ec959/0x26817551a4475de1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8343 expref: 8 pid: 19466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.415071:0:19466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c7ec959/0x26817551a4475de1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8343 expref: 8 pid: 19466 timeout: 693 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388272.415085:0:19466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b72b58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19466:1874211945796736:192.168.203.15@tcp:104: 00000100:00100000:3.0:1787388272.415164:0:19466:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b455ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1787388272.418609:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.418805:0:19466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b72b58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19466:1874211945796736:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388272.418836:0:19466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 8 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.418857:0:19466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a432f7000, rc 0) 00000100:00100000:1.0:1787388272.418914:0:19466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+8:15722:x1874211925798272:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 3990us (4278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.418922:0:19466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:2.0:1787388272.419020:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925798400 00000100:00100000:2.0:1787388272.419027:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925798400 00010000:00010000:2.0:1787388272.419057:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c7ec959/0x26817551a4475de1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8343 expref: 8 pid: 19466 timeout: 693 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388272.419086:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:2.0:1787388272.419094:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+8:2401:x1874211925798400:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388272.419108:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388272.419129:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c7ec959/0x26817551a4475de1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8343 expref: 8 pid: 19466 timeout: 693 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.419142:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c7ec959/0x26817551a4475de1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8343 expref: 8 pid: 19466 timeout: 693 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.419168:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7ec959/0x26817551a4475de1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8343 expref: 8 pid: 19466 timeout: 693 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.419180:0:17081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388272.419185:0:17081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388272.419191:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 7 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.419201:0:17081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 7 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.419253:0:17081:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 7 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388272.419266:0:17081:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b7c0c9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17081:1874211945796864:192.168.203.15@tcp:105: 00000100:00100000:2.0:1787388272.419317:0:17081:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b50ce8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388272.423199:0:17081:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b7c0c9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17081:1874211945796864:192.168.203.15@tcp:105: 00010000:00010000:2.0:1787388272.423226:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388272.423280:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:2401:x1874211925798400:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 4186us (4679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.423290:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1787388272.426257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.426531:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925798528 00000100:00100000:1.0:1787388272.426540:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925798528 00000100:00100000:1.0:1787388272.426603:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:1.0:1787388272.426612:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:2401:x1874211925798528:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787388272.426750:0:18601:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787388272.426754:0:18601:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787388271 00002000:00010000:1.0:1787388272.426756:0:18601:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787388269 00002000:00010000:1.0:1787388272.426758:0:18601:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787388272 -> 1787388271 00002000:00010000:1.0:1787388272.426771:0:18601:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787388272.426837:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+8:2401:x1874211925798528:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 226us (588us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787388272.426844:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:3.0:1787388272.430132:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.430263:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925798656 00000100:00100000:1.0:1787388272.430272:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925798656 00000100:00100000:1.0:1787388272.430330:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:1.0:1787388272.430339:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+8:2401:x1874211925798656:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787388272.430410:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.430430:0:18600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 8 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.430438:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787388272.430443:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787388272.430447:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.430481:0:18600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 8 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.430495:0:18600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 8 pid: 19466 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388272.430509:0:18600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18600:1874211945796992:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388272.430592:0:18600:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b620f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787388272.434494:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388272.434728:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925798784 00000100:00100000:3.0:1787388272.434737:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925798784 00010000:00010000:3.0:1787388272.434796:0:18625:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 9 pid: 19466 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388272.434841:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1787388272.434851:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+9:2402:x1874211925798784:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388272.434865:0:18625:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388272.434886:0:18625:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 9 pid: 19466 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.434918:0:18625:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 9 pid: 19466 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.434944:0:18625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388272.434948:0:18625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787388272.434965:0:18625:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.434975:0:18625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.434995:0:18625:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388272.435046:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+9:2402:x1874211925798784:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 197us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.435054:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00010000:00010000:1.0:1787388272.435712:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3f25a80/0x26817551a4475def lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe834a expref: 8 pid: 19466 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388272.435741:0:18600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18600:1874211945796992:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388272.435773:0:18600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.435793:0:18600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.435800:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.435823:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.435832:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.435841:0:18600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.435848:0:18600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b4838ec00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388272.435853:0:18600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.435862:0:18600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.435886:0:18600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.435893:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eec8f69c/0x26817551a4475df6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388272.435961:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:2401:x1874211925798656:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 5623us (5836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.435969:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:2.0:1787388272.441407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.441804:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925799040 00000100:00100000:1.0:1787388272.441813:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925799040 00000100:00100000:1.0:1787388272.441871:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:1.0:1787388272.441881:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+15:15722:x1874211925799040:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787388272.441968:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.441985:0:17094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e8 expref: 15 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.441995:0:17094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.442029:0:17094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e8 expref: 15 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.442042:0:17094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e8 expref: 15 pid: 17094 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388272.442067:0:17094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17094:1874211945797120:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388272.442144:0:17094:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b620f0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787388272.448752:0:17094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17094:1874211945797120:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388272.448800:0:17094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388272.450663:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388272.451520:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925799168 00000100:00100000:3.0:1787388272.451531:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925799168 00010000:00010000:3.0:1787388272.451623:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e8 expref: 16 pid: 17094 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787388272.451665:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:3.0:1787388272.451675:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+16:2401:x1874211925799168:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787388272.451690:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787388272.451696:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e8 expref: 16 pid: 17094 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.451727:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e8 expref: 16 pid: 17094 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.451749:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70076400/0x26817551a4475cd0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe82e8 expref: 16 pid: 17094 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.451886:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:3.0:1787388272.451895:0:17082:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475d63 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8319 expref: 15 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.451905:0:17082:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.451911:0:17082:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.451918:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787388272.452046:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787388272.452105:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+15:2401:x1874211925799168:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 431us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.452114:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00010000:00010000:1.0:1787388272.453789:0:17094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.453804:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.454117:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.454133:0:17094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475dcc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8335 expref: 15 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.454141:0:17094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.454176:0:17094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475dcc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8335 expref: 15 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.454189:0:17094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475dcc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8335 expref: 15 pid: 17094 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388272.454203:0:17094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17094:1874211945797248:192.168.203.15@tcp:104: 00000100:00100000:1.0:1787388272.454278:0:17094:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b620f0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787388272.466246:0:17094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17094:1874211945797248:192.168.203.15@tcp:104: 00010000:00010000:1.0:1787388272.466279:0:17094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388272.467883:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388272.468312:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925799296 00000100:00100000:3.0:1787388272.468322:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925799296 00010000:00010000:3.0:1787388272.468501:0:18625:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475dcc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8335 expref: 16 pid: 17094 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787388272.468691:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1787388272.468703:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b74e64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+16:2401:x1874211925799296:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787388272.468717:0:18625:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787388272.468724:0:18625:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475dcc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8335 expref: 16 pid: 17094 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.468737:0:18625:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475dcc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8335 expref: 16 pid: 17094 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.468758:0:18625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077e00/0x26817551a4475dcc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8335 expref: 16 pid: 17094 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.468793:0:18625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996a43284a00) 00010000:00010000:2.0:1787388272.468798:0:18625:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.468807:0:18625:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.468815:0:18625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.468845:0:18625:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787388272.468900:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b74e64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+15:2401:x1874211925799296:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 199us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.468909:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00010000:00010000:1.0:1787388272.469339:0:17094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.469380:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787388272.469486:0:17094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1787388272.469609:0:17094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1787388272.469643:0:17094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1787388272.469714:0:17094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17094:1874211945797376:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787388272.469762:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388272.469804:0:17094:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b739b2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787388272.470033:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945797376 00000100:00100000:3.0:1787388272.470041:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945797376 00000100:00100000:3.0:1787388272.470086:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787388272.470093:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996a43379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17094:x1874211945797376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787388272.470170:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996a43379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17094:x1874211945797376:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388272.470177:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787388272.471180:0:17094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17094:1874211945797376:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787388272.471337:0:17094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1787388272.471655:0:17094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17094:1874211945797504:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787388272.471699:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787388272.471716:0:17094:0:(client.c:2702:ptlrpc_set_wait()) set ffff996a41f06a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787388272.471911:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211945797504 00000100:00100000:3.0:1787388272.471917:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211945797504 00000100:00100000:3.0:1787388272.471967:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787388272.471974:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17094:x1874211945797504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787388272.472081:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17094:x1874211945797504:12345-0@lo:1000:mdt00_000.0 Request processed in 107us (381us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787388272.472087:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787388272.472459:0:17094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996a43378000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17094:1874211945797504:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787388272.472498:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472508:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472532:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472536:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b4838ec00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388272.472540:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472547:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472654:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996a43284a00) 00010000:00010000:1.0:1787388272.472659:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388272.472663:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472670:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e04 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472700:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472707:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472712:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472717:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a432f7800 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388272.472720:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472734:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472744:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388272.472746:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787388272.472752:0:17094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475d63 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8319 expref: 18 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472762:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475d63 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8319 expref: 18 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472770:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475d63 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8319 expref: 18 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.472829:0:17094:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff996b70077800/0x26817551a4475d63 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8319 expref: 18 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388272.472841:0:17094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996b738eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17094:1874211945797632:192.168.203.15@tcp:105: 00000100:00100000:1.0:1787388272.472937:0:17094:0:(client.c:2702:ptlrpc_set_wait()) set ffff996b72981300 going to sleep for 11 seconds 00000100:00100000:1.0:1787388272.476186:0:17094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996b738eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17094:1874211945797632:192.168.203.15@tcp:105: 00010000:00010000:1.0:1787388272.476216:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476226:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a432f7800/0x26817551a4475d5c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476257:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e0b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476294:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e0b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476304:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e0b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476313:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e0b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476319:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e0b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476325:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e0b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476330:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b4838e400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388272.476334:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e0b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476340:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e0b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476383:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388272.476386:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388272.476390:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e0b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476395:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e0b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476405:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476417:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476423:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476428:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b4838ee00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388272.476431:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476436:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476443:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388272.476446:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787388272.476448:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.476454:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475dfd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388272.476599:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+18:15722:x1874211925799040:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 34719us (35201us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1787388272.476608:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00000020:00080000:1.0:1787388272.476614:0:17094:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787388272.477519:0:17130:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787388272.477525:0:17130:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388272.477541:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787388272.477549:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787388272.479736:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388272.479814:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925799424 00000100:00100000:2.0:1787388272.479824:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925799424 00000100:00100000:2.0:1787388272.479872:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:2.0:1787388272.479881:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+18:15721:x1874211925799424:12345-192.168.203.15@tcp:49:bash.0 00000100:00100000:2.0:1787388272.480020:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+18:15721:x1874211925799424:12345-192.168.203.15@tcp:49:bash.0 Request processed in 139us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.480028:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:0.0:1787388272.482903:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388272.483222:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925799680 00000100:00100000:2.0:1787388272.483233:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925799680 00000100:00100000:2.0:1787388272.483286:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:2.0:1787388272.483295:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+18:15722:x1874211925799680:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787388272.483728:0:17097:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787388272.483789:0:17097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1787388272.483824:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.483840:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.483853:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.483861:0:17097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.483869:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.483874:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.483928:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787388272.484030:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+20:15722:x1874211925799680:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 734us (1134us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1787388272.484040:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000020:00080000:2.0:1787388272.484045:0:17097:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787388272.488597:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388272.488773:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925799808 00000100:00100000:2.0:1787388272.488793:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925799808 00000100:00100000:2.0:1787388272.488851:0:19466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:2.0:1787388272.488861:0:19466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+7:15721:x1874211925799808:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1787388272.488881:0:19466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388272.488903:0:19466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071c91d78/0x26817551a4475e19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8351 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787388272.488948:0:19466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a89616f, atime: 0x6a89616d, ctime: 0x6a89616f, blocks: 0x0 00010000:00010000:2.0:1787388272.488982:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787388272.488987:0:19466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787388272.488996:0:19466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c91d78/0x26817551a4475e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8351 expref: 8 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.489014:0:19466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000071c91d78/0x26817551a4475e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8351 expref: 8 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.489027:0:19466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e5600, rc 0) 00000100:00100000:2.0:1787388272.489081:0:19466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+8:15721:x1874211925799808:12345-192.168.203.15@tcp:101:bash.0 Request processed in 221us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388272.489088:0:19466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00010000:00010000:1.0:1787388272.489313:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787388272.489322:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.489329:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996a431e5c00 already unused, calling callback (ffffffffc0ce4e90) 00010000:00010000:1.0:1787388272.489342:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.489376:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.489391:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996a43284a00) 00010000:00010000:1.0:1787388272.489394:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787388272.489397:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.489404:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5c00/0x26817551a4475e12 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.489416:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388272.489418:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787388272.489420:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787388272.492156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1787388272.492290:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925799936 00000100:00100000:0.0:1787388272.492300:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925799936 00000100:00100000:0.0:1787388272.492542:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:0.0:1787388272.492552:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+20:15721:x1874211925799936:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1787388272.492591:0:20233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787388272.492609:0:20233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08800/0x26817551a4475e20 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe8358 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388272.492636:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09a00/0x26817551a4475e27 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388272.492647:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09a00/0x26817551a4475e27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388272.492657:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09a00/0x26817551a4475e27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388272.492753:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e08800/0x26817551a4475e20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8358 expref: 22 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388272.492770:0:20233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996b74e09a00/0x26817551a4475e27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe8358 expref: 21 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787388272.492788:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:0.0:1787388272.492792:0:20233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787388272.492795:0:20233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996b74e09a00, rc 0) 00000100:00100000:0.0:1787388272.492851:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+21:15721:x1874211925799936:12345-192.168.203.15@tcp:101:bash.0 Request processed in 300us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388272.492858:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:3.0:1787388272.497862:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.497969:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925800192 00000100:00100000:1.0:1787388272.497978:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925800192 00000100:00100000:1.0:1787388272.498022:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:1.0:1787388272.498031:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+21:15721:x1874211925800192:12345-192.168.203.15@tcp:35:bash.0 00000001:00080000:1.0:1787388272.498231:0:17098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:1.0:1787388272.498963:0:17098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:1.0:1787388272.499092:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+24:15721:x1874211925800192:12345-192.168.203.15@tcp:35:bash.0 Request processed in 1060us (1237us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1787388272.499100:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000020:00080000:1.0:1787388272.499106:0:17098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787388272.616825:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388272.617561:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925800448 00000100:00100000:2.0:1787388272.617573:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925800448 00000100:00100000:2.0:1787388272.617649:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:2.0:1787388272.617660:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+24:15732:x1874211925800448:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1787388272.617681:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787388272.617701:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a4475e2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf2fd04bc56fe835f expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787388272.617810:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787388272.617904:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a4475e2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe835f expref: 26 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.617934:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996b73b48400) 00010000:00010000:2.0:1787388272.617937:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787388272.617942:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996a431e5000/0x26817551a4475e2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0xf2fd04bc56fe835f expref: 26 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787388272.617954:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996a431e5000, rc 0) 00000100:00100000:2.0:1787388272.618022:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+25:15732:x1874211925800448:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 363us (1206us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787388272.618030:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 72 00010000:00010000:0.0:1787388272.621924:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787388272.624667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.624748:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925800576 00000100:00100000:1.0:1787388272.624759:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925800576 00000100:00100000:1.0:1787388272.624821:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:1.0:1787388272.624831:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+25:15732:x1874211925800576:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:1.0:1787388272.624918:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475e3c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.624936:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475e3c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.624948:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475e3c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.624963:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.624970:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.624977:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625053:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625063:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625071:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787388272.625130:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625144:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475e3c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625162:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475e3c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625168:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475e3c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625174:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b4838ee00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388272.625179:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475e3c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625186:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475e3c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625198:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996b4a814500) 00010000:00010000:1.0:1787388272.625201:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388272.625205:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475e3c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625210:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ee00/0x26817551a4475e3c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625224:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625230:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e43 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625236:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625240:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b4838e400 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388272.625249:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625256:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625264:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff996b73b48c00) 00010000:00010000:1.0:1787388272.625267:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388272.625270:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e43 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625276:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838e400/0x26817551a4475e43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625291:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625297:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625304:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625309:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996b4838ec00 already unused, calling callback (ffffffffc18ee4f0) 00010000:00010000:1.0:1787388272.625312:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625318:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625325:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996b73b48100) 00010000:00010000:1.0:1787388272.625328:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787388272.625337:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787388272.625343:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996b4838ec00/0x26817551a4475e4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787388272.625460:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+25:15732:x1874211925800576:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 629us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388272.625470:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:3.0:1787388272.627899:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388272.628048:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925800832 00000100:00100000:1.0:1787388272.628059:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925800832 00000100:00100000:1.0:1787388272.628125:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:1.0:1787388272.628135:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+25:15732:x1874211925800832:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:1.0:1787388272.628381:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+26:15732:x1874211925800832:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 212us (455us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1787388272.628391:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:3.0:1787388273.416030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388273.416078:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388273.416232:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925800960 00000100:00100000:3.0:1787388273.416242:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388273.416242:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925800960 00000100:00100000:1.0:1787388273.416297:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 167 00000100:00100000:1.0:1787388273.416307:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b622b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:2401:x1874211925800960:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388273.416409:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b622b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bcdc57b-3459-40d2-a2c1-acec130207c7+13:2401:x1874211925800960:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 101us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388273.416410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388273.416422:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 167 00000100:00100000:2.0:1787388273.416543:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925801216 00000100:00100000:2.0:1787388273.416548:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925801216 00000100:00100000:2.0:1787388273.416591:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925801728 00000100:00100000:2.0:1787388273.416595:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925801728 00000100:00100000:2.0:1787388273.416622:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:2.0:1787388273.416630:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2401:x1874211925801216:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388273.416652:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925801472 00000100:00100000:0.0:1787388273.416658:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925801472 00000100:00100000:2.0:1787388273.416664:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2401:x1874211925801216:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 35us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388273.416671:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:2.0:1787388273.416690:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:2.0:1787388273.416698:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7fa19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925801728:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388273.416703:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:0.0:1787388273.416724:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b72b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2401:x1874211925801472:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388273.416728:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7fa19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925801728:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388273.416737:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:0.0:1787388273.416763:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b72b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+5:2401:x1874211925801472:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 42us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388273.416770:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00080000:1.0:1787388273.416952:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787388273.416957:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787388273.417433:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1787388273.417591:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925801984 00000100:00100000:1.0:1787388273.417596:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925801984 00000100:00100000:1.0:1787388273.417650:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:1.0:1787388273.417664:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7aa16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925801984:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388273.417720:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7aa16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925801984:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 56us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388273.417725:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00080000:2.0:1787388273.418378:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787388273.422573:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388273.422620:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388273.422652:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388273.422678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1787388273.422901:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925801088 00000100:00100000:2.0:1787388273.422910:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925801088 00000100:00100000:0.0:1787388273.422921:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925801344 00000100:00100000:0.0:1787388273.422927:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925801344 00000100:00100000:2.0:1787388273.422969:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925801600 00000100:00100000:0.0:1787388273.422971:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925801856 00000100:00100000:2.0:1787388273.422973:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925801600 00000100:00100000:0.0:1787388273.422976:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925801856 00000100:00100000:1.0:1787388273.423040:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:1.0:1787388273.423053:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7fa19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+8:2401:x1874211925801344:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388273.423120:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7fa19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+8:2401:x1874211925801344:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 71us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388273.423127:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:1.0:1787388273.423249:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:1.0:1787388273.423256:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+26:2401:x1874211925801088:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1787388273.423288:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+26:2401:x1874211925801088:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 33us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787388273.423293:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:2.0:1787388273.423407:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:2.0:1787388273.423414:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2401:x1874211925801600:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1787388273.423446:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+6:2401:x1874211925801600:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 33us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787388273.423452:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:0.0:1787388273.427070:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:0.0:1787388273.427097:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7fa18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925801856:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1787388273.427203:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7fa18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c15ba50-0abc-4066-8c74-637a6ad6a0f7+5:2401:x1874211925801856:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 112us (4522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787388273.427211:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00080000:2.0:1787388273.435648:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787388273.435660:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787388273.516697:0:17130:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787388273.516707:0:17130:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787388273.516727:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787388273.516735:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787388273.644697:0:19469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787388274.345269:0:20271:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1787388274.668929:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787388275.462837:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388275.464001:0:19466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925802240 00000100:00100000:3.0:1787388275.464019:0:19466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925802240 00000100:00100000:3.0:1787388275.464135:0:19466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:3.0:1787388275.464150:0:19466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b738eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+8:2401:x1874211925802240:12345-192.168.203.15@tcp:16:kworker.0 00000100:00080000:0.0:1787388275.464679:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787388275.465016:0:19466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b738eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+8:2401:x1874211925802240:12345-192.168.203.15@tcp:16:kworker.0 Request processed in 863us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787388275.465029:0:19466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:1.0:1787388275.467842:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1787388275.468577:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874211925802112 00000100:00100000:3.0:1787388275.468596:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874211925802112 00002000:00100000:3.0:1787388275.468664:0:18604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff996b7c10a300 x1874211925802112/t0(0) o4->59c9ee7e-2d2a-46d3-bbea-ecefe0429e94@192.168.203.15@tcp:531/0 lens 504/0 e 0 to 0 dl 1787388286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787388275.468677:0:18604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b7c10a300 with x1874211925802112 ext(0->8) 00002000:00010000:3.0:1787388275.468685:0:18604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b7c10a300 00000100:00100000:3.0:1787388275.468718:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:3.0:1787388275.468728:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996b7c10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+8:2401:x1874211925802112:12345-192.168.203.15@tcp:4:bash.0 00000100:00100000:3.0:1787388275.472262:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996b7c10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:59c9ee7e-2d2a-46d3-bbea-ecefe0429e94+10:2401:x1874211925802112:12345-192.168.203.15@tcp:4:bash.0 Request processed in 3517us (4412us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787388275.472288:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00002000:00100000:3.0:1787388275.473621:0:18604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff996b7c10a300 x1874211925802112/t8589934599(0) o4->59c9ee7e-2d2a-46d3-bbea-ecefe0429e94@192.168.203.15@tcp:531/0 lens 504/448 e 0 to 0 dl 1787388286 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787388275.473636:0:18604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996b7c10a300 with x1874211925802112 ext(0->8) 00002000:00010000:3.0:1787388275.473646:0:18604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996b7c10a300 00010000:00010000:0.0:1787388275.712609:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43218 lines, 43218 kept, 0 dropped, 0 bad.